WESEE – DETECTING SHOPLIFTING THANKS TO ARTIFICIAL INTELLIGENCE
WeSee is a computer vision platform aiming to automatically detect shoplifting activities and supporting retailers to reduce the originating loss. WeSee can analyse in real-time video streams leveraging existing retailer camera and WeSee IoT devices, custom cloud technologies and tailor-made machine learning models. Customers are instantaneously notified via a dedicated mobile application.
- About the product
- About the customer
- The challenges
- Project Solution
- Project Results
- Success factors
- What the customer says...
About the product
WeSee is a product imagined and developed by ARHS Spikeseed. When elaborating the solution, ARHS Spikeseed teams had to go through several steps:
Create custom datasets targeting specific behaviors
Train tailor-made ML models to detect desired behaviors
Install, configure, and operate IoT devices at client premises
Design and implement the global platform, ranging from the development of the mobile application to the automated remote deployment of the solution running on IoT device.
About the customer
Our typical customers are leaders in the retail industry, such as stores and hypermarkets, who are victims of recurrent theft activities. By leveraging WeSee, our customers want to reduce shoplifting by providing a reliable and cost-effective supporting tool to their human workforce:
Security teams are automatically altered in case a suspicious activity is detected. A video recording is immediately made available via the dedicated mobile application, supporting their interventions.
Our teams faced and went over multiple challenges from the elaboration until the rollout of the product:
Creating custom datasets specific to shoplifting use cases is challenging because video surveillance images and videos are not publicly available
Analyzing in real-time massive streams from +100 cameras requires an efficient hardware scaling, but also intensive optimization of the application
Reidentify people across different cameras and camera angles is a difficult task that needs to implement state-of-the-art research
When designing the solution, ARHS Spikeseed teams evaluated the AWS services portfolio, and identified the following building blocks:
The deployment and management of IoT devices leverages AWS Greengrass
The database layer features AWS DynamoDB
AWS CloudWatch monitors model training and IoT device activity
Custom image classifier models are trained via AWS EC2 instances
Images, recordings of suspicious activities and Machine Learning models are stored on AWS S3
The WeSee altering system is implemented thanks to AWS SNS
Machine Learning models are created thanks to PyTorch framework, either from scratch or leveraging transfer learning, and their generation is boosted via TensorRT
Custom WeSee hardware decodes RTSP streams
OpenCV and PyTorch retrieve the video streams, then resize, convert and normalize the frames
As a result, the WeSee computer platform provides retailers with on-the-shelve tools to automatically detect shoplifting:
- Dedicated mobile application, available on Google Play and Apple Store
- Automated installation and configuration of WeSee IoT devices, connected to existing retailer’s camera
- Remote deployment and update of IoT software
- Configuration of retailer opening hours for the edge running applications, optimizing the cost of the solution, and preventing false-positive detections
- Remote monitoring of model performances
- Remote maintenance of IoT devices
- Deployment in various environments
ARHS Spikeseed extensive experience in developing Cloud native and state-of-the-art Artificial Intelligence solutions let to develop an efficient and low-cost solution adapted to its clients in the retail market. It is clear the WeSee platform helps to reduce the costs related to theft.
What the customer says...
The WeSee platform is efficient and provides a real assistance to our detectives. It also allows us to improve and optimise our internal practices.