What is a Video Search Engine? Part V – Detecting Objects

After discussing the ability to video search for Speech, Text, Motion, Face and Emotions, the next big element class is “Objects”.

video search engine object detection

Essentially, it is an analysis tool that extracts metadata from a video and defines important objects or entities inside a video. Object detection has come to a point where it can detect objects or entities (like cat, flower, computer, etc.) and pinpoint the exact location there is the scene(s) appear inside the video.

The purpose of Object Detection is to help us better understand the overall content of our videos based on objects detected within the video. It also gives uas a time-based understanding on when each object appears within the video. Object Detection basically uses tagging and domain-specific models to identify content and label it with confidence.

Like other vision type of video searches, Computer Vision scientists developed Object Recognition based on the deep learning technology developed using deep neural network models to detect and label thousands of objects and scenes in videos.

video search engine object detection

With Object Detection, it is now possible to search every moment of every video file in your video library and catalog to find every objects as well as its importance.

To find out more about how you can detect objects inside your videos, visit VideoSpace Video Search Engine or our Video-Search-as-a-Service.

Announcement – Adding “Object Detection” to VideoSpace Search Engine

We are delighted to announce that we are adding “Object Detection” capability to our Video Search Engine.

This is a significant milestone as it enhances our already extensive video search capabilities. Thus, establishing VideoSpace Search Engine’s as one of the most powerful Video Search Engine in the world.

Thus, adding to the list of elements that we can index and search inside videos:

  • Objects (NEW!)
  • Speech
  • Text
  • Motion
  • Face
  • Emotion
  • Offensive Content
  • Custom (e.g. Logos, Objects, Landmarks, etc.)
videospace search engine object detection

The new “Object Detection” feature enables us to detect entities (like cat, flower, computer, etc.) and pinpoint the exact location there is the scene(s) appear inside the video.

For example, in this short four minute video (http://demo.videospace.co/vod/detail.aspx?vid=90c9dc8d-c0b7-49b4-883d-f7da60472c30), we are able to:

  • detect 111 unique entities
  • mark exactly where these 111 entities appear

To find out more about Object Detection in videos, please click HERE.

What is a Video Search Engine? Part IV – Detecting Faces and Emotions

The ability to detect faces has been around for some time for real time CCTV systems. However, these systems remain out of reach for many as they are expensive and would need specialized implementation that would drive the cost up higher. Therefore, detecting faces from videos instead is a viable alternative because it instantly adds face detection ability to any CCTV system.

Detecting faces allows you to count, track movements by detecting unique faces. Face detection finds and tracks human faces within a video. Multiple faces can be detected and subsequently be tracked as they move around.

video search engine face detection

This will be useful to analyze human traffic within a mall, street or even a restaurant or café. It would be possible to identify and track movement of unique human faces. Therefore, it is possible to perform a headcount of human traffic within the video. 

Beyond detecting faces, it is more possible to detect emotions. Emotion Detection is an extension of the Face Detection video search that returns analysis on multiple emotional attributes from the faces detected, for example happiness, sadness, fear, anger, etc.

video search engine emotion detection.jpg

Recognizing the emotion of a person or crowd over time based allows us to track the emotional highs and lows within a particular time-frame. It also allows us to track someone’s emotions at a specific point of time. Answering questions like, how did the crowd react when the President makes a particular point? With emotion detection, it can be applicable to gauge audience responses in scenarios like:

  • Speeches
  • Focus groups
  • Group reactions
  • Interviews

Emotion detection can form a very good baseline for the scenarios above.

To find out more about how you can detect faces and emotions inside your videos, visit VideoSpace Video Search Engine or our Video-Search-as-a-Service.