The Web 3.0's Pulse : Semantic Web Trends

Currently Hot: Facebook OpenGraph Protocol

Thursday, July 8, 2010

Facebook Tagging - Semantic Photo Annotation for Free

What is behind the photo tagging feature on Facebook? This seemingly meaningless feature, now allows Facebook to gain digital knowledge of how each person looks, even if the user herself hasn't uploaded a photo of herself yet. But what this feature also means, is that ordinary people around the world, spend their free time to uploading photos, tagging their friends in various positions and occassions. Do you know what this means ? That resources (photos) on Facebook are being annotated manually with high accuracy for free! It seems like we are not far from our digital avatars, after all...

Hidden Semantics in Photos

Many people love the Facebook photo tagging feature : the user basically uploads a photo, tags her friends on the photo and they get pleasant notification that they have been tagged on a certain photo and everyone is happy. But what most people are not aware of, is that by adding tags to photos, they provide Facbook with ground to apply facial recognition algorithms and even more: the hard and manual job of annotating resources with their semantic meaning with at least 95% proven accuracy! Many cannot even recognize it: every time you tag someone on a photo, you basically tell Facebook, the following information:

On the resource [X], the resource [Y] is located on the resource [Z] , 
where [X] is of type Photo, [Y] is of type Person , [Z] is of type Coordinate.
[Y] and [Me] are friends. 
OPTIONAL: [X] is published on the resource [P] , where [P] is a page,
which is in turn relevant to resources [P1,P2...Pn] where [P1] is [SportsTeam].
[Y] likes the resource [P].

Pretty much metadata in a simple tag isn't it ? A semantic software agent (with existent technology) can easily deduce that there is a good chance that you (or the resource [Me]) likes the sports team P1, so why shouldn't it try to suggest you the page P1 ? What if there are other people on the photo that you are not friends with ? Then it is certainly wise to suggest them as your friends since you have been tagged on N photos together, but you are still not friends. This is only a sample of the usage of the semantics embedded within the photos. This system is unique from all aspects. Besides the fact that is free, it is also self -cleaning! What if someone faulty tags to some people? Those people will disagree and remove those tags. Very impressive mechanism, and do not forget it is part of the OpenGraph!

Who still needs to draw photo robots ?

The new exciting new Facebook feature of aiding users while they are trying to tag their friends set off a lot of dust lately. Some users are scared as they now are aware that Facebook recognizes the people in the photo, and will easily gain knowledge on who is on the photo.Imagine how easy is gathering sample set photos for constructing digital profile of each of us:

Give me the photos where [X] is tagged (optional: in the center  of the photo ) :)

Then facial recognition algorithms can be applied and ... ta daam... your face is recognized, along with your real name, surname, who your friends are,  what you like .. interetsting info, don't you think ? Another interesting thing: let's say that you refuse to upload photo of yourself on Facebook. Do you think you can avoid face recognition ? Unfortunately, no, you can't. Your friends will once in a while upload a photo of you and tag you there. So in a good percentage of the photos it will be you and they could draw an image of you even without you uploading a single image of yourself. Oh, and I forgot, a photo where you are tagged is placed as your personal photo by default :) . Creepy feeling  Way to go, Facebook


What do you readers think about Facebook tagging ? Does it really bring extra information to the "Big Face"? Is one's privacy violated in such case ?

1 comments:

bcmoney said...

This is a new level in Facebook creepiness, and it doesn't make "The Onion" perspective too far off:
http://www.theonion.com/video/cias-facebook-program-dramatically-cut-agencys-cos,19753/

Post a Comment