Using Semantic Search on Video Sites with Semex and Media Globe


Add to iTunes | Add to YouTube | Add to Google | RSS Feed

Semantic search attempts to improve accuracy – and your search experience – by understanding contextual meaning of terms. Being able to use semantic search within multimedia is an issue that all video sites are working hard to solve. Think of it this way: you can head to YouTube and perform a simple search for a person without having to use any type of description of keywords. The search would then bring up every video that person appears in – and ONLY those videos.

Try finding every video related to a specific location, function or your favorite sports teams. It can be frustrating, to say the least. Semantic search is needed to make all of these things possible, and Media Globe is promising to deliver.

Media Globe was demonstrated during ceBIT 2011 by Nadine Ludwig and Jorg Waitelonis. The ultimate goal is to make the quickly growing amount of digital media easy to find and use.

The project aims to develop more effective approaches to digitize data and then combine that data with metadata. This is an important step on the path to true semantic search – and the simple navigation of large audio-visual collections, such as found on YouTube.

The semantic media explorer isn’t ready to ship yet, but man is it awesome. It’s a sort of intelligent video search engine. They are doing video analysis using optical character recognition and speech recognition within a video and its audio stream. From all of the extracted metadata, you will be able to detect people, events and places within the video transcript. This makes it a snap for you to filter search results in an intelligent way.

Using an existing video archive, Jorg did a simple keyword search. The software immediately asked him what it was he meant. It asked whether he meant to look for a person, state or venue. Basically, it’s asking for the meaning of the search term. Instead of typing in a word with an ambiguous meaning and receiving millions of results which don’t match, you’re going to get exactly what you’re looking for!

The company looks for this to ship sometime late next year. I’m thinking this is definitely something that Google should look into buying for its YouTube property.

One thought on “Using Semantic Search on Video Sites with Semex and Media Globe”

Comments are closed.