Deepjewel - Social Media powering Recommendations

Wednesday, January 4, 2012

Hi all,

Happy new year!  My first post this year will be about an idea that I had with my friend Ricardo Caspirro about the next generation of social recommenders in commerce applications and retail stores. What excites me is that this idea came from a conversation that we had in 2009, and since that year we discussed more about what it would be the "Deepjewel".

Deepjewel is a giant knowledge base that encapsulates interesting entities and relationships of the social world in the web.  The social world in this context means all the millions and billions of tweets, Facebook messages, profiles, relationships, blog posting, YouTube videos, and more - a living organism itself, constantly evolving. 

The Deepjewel

But what motivated us to create the Deepjewel?  One of main problems that we face nowadays is the discovery of content and items of our interest.  Many times, for instance, to find a book or a movie that we like, it is required to search at several websites and social networks through the web.  There isn't a tool that allow this connection between items of many domains in a organized and structured way, even for easy access. Those objects are spread over the web, and the recommendations are placed in social networks by comments, results of machine learning techniques or by queries at several web pages or search engines.  The problem becomes worst when we don't know anything about the existence of a certain item, which it could result at never finding out that possible item that would be of our interest. 

The social media is huge and we need tools that performs a deep analysis of all this data, filter out items of my interest, specially from the historical data  (with our permission, of course)  from our presence in the web and bring items and products relevant to us without loosing the discovery process associated with the serendipity.  One of the solutions is a powerful recommender engine fed by this Social Genome.

Hybrid Social Context-Aware Recommender RecDay

This hybrid social context-aware recommender (which we call recday) is a engine composed by several modular components, which we employ a broad range of semantic analysis techniques, including information extraction and integration, natural language processing and machine learning. The main task of this recommender is to analyze information about his posts, bios and relationships/lists collected from the social genome and summarize it (all this data would represent the interests of the user) in profiles, which we could call DNA. Those profiles built by the recday would infer the possible interests of the users and would serve as basis for personalized recommendations of products and services from the retail stores/e-commerce applications.

A perfect example for this proccess, which we call the translation, is when you mentioned several times about Apple products (such as macbook, ipod, iphone, etc) at your tweets. Even you never used the word "Apple", we can use the Social Genome to detect the products and infer that you are interested in Apple products. The following figure illustrate certain kinds of entities and relationships collected in the Social Genome:

The relationships extracted from the social web data

The second step of this engine is to build the user profile. Different from another approaches which it only uses the content or the historical data from reviews or ratings from the user, the Recday would go further and would analyze the temporal context included in the interests of the user. Several reports on consumer behavior show that the user desires are influented by external factors and even the humour or feelings of the person at the certain moment. It is required to collect in a stealth way (with the user permission of course) his social data and build his personality defined by several dimensions. Those dimensions represent the current state of the user which may define what kind of suggestions he would like to receive at that particular moment. For example, if you are happy today because you got a new job and posted at your Facebook about that event or even updated your profile about this new position, it would be a valuable information for your DNA profile in order to recommend products and services to celebrate this occasion (You are happy and excited, don't you think ?).

Another important component in this proccess is the product side. We need extract more information from their products portfolio. Items must be juiced in order to get all its meta-data available. Imagine the movie Batman where we have details about the year, genre, cast, production, direction, sinoypsis, etc. All this data can be used to build the DNA Item and be expressed by a collection of dimensions that represent the item profile. With those profiles (DNA User and DNA Item) we compute the similarity between user and items in order to produce a list of top recommendations and related explanations.

The Social Architecure of the Recommender

The final result can be shown in several mediums: mobile apps, widgets, web, API's, pluggins, etc. It is important the usability and how you will present all this information for a particular user. That's why the user interface must be simple and easy to navigate and have mechanisms to collect the user's feedback for the suggestions given by the engine. This proccess is cyclic, so when you give a feedback (a like or dislike or a comment about the suggestion), this piece of information is handled and leveraged to power your DNA profile.

A particular medium of the recommendations: Ipad Demo

In order to build all these interesting technical challenges, we needed to start developing our in-house solution called Crab, which proccesses all this data and employ several analysis and filtering techniques  to deal with the percularities of this heterogeneous sources of data. The first start is the launch of the Deepjewel Labs. Deepjewel is a principle that we can mine the wealth in data, by identifying interesting entities and relationships and converting them into valuable information as input in the recommendation proccess of items and services. 

In summary, all those human and computation techniques can be used to perform a deep semantic analysis of web and social data, where the result for a commerce application or retail store is the ability to offer what the users want before they know that they really want in a personalized way. The RecDay  would be able to daily offer relevant product and services to their customers without they even know it exists. This is a new way to shop in which you don't have to go find products, service and information; the machine will help them find their way to you.

To know more about our Deepjewel labs, visit the website (currently in portuguese):  

I hope you enjoyed,

Marcel Caraciolo


  1. hmm this tool is interesting, but I cant still get the entire concept.

    social media sales MA

  2. Welcome to Wiztech Automation - Embedded System Training in Chennai. We have knowledgeable Team for Embedded Courses handling and we also are after Job Placements offer provide once your Successful Completion of Course. We are Providing on Microcontrollers such as 8051, PIC, AVR, ARM7, ARM9, ARM11 and RTOS. Free Accommodation, Individual Focus, Best Lab facilities, 100% Practical Training and Job opportunities.

    Embedded System Training in chennai
    Embedded System Training Institute in chennai
    Embedded Training in chennai
    Embedded Course in chennai
    Best Embedded System Training in chennai
    Best Embedded System Training Institute in chennai
    Best Embedded System Training Institutes in chennai
    Embedded Training Institute in chennai
    Embedded System Course in chennai
    Best Embedded System Training in chennai

  3. Embedded system training: Wiztech Automation Provides Excellent training in embedded system training in Chennai - IEEE Projects - Mechanical projects in Chennai. Wiztech provide 100% practical training, Individual focus, Free Accommodation, Placement for top companies. The study also includes standard microcontrollers such as Intel 8051, PIC, AVR, ARM, ARMCotex, Arduino, etc.

    Embedded system training in chennai
    Embedded Course training in chennai
    Matlab training in chennai
    Android training in chennai
    LabVIEW training in chennai
    Robotics training in chennai
    Oracle training in chennai
    Final year projects in chennai
    Mechanical projects in chennai
    ece projects in chennai

  4. WIZTECH Automation, Anna Nagar, Chennai, has earned reputation offering the best automation training in Chennai in the field of industrial automation. Flexible timings, hands-on-experience, 100% practical. The candidates are given enhanced job oriented practical training in all major brands of PLCs (AB, Keyence, ABB, GE-FANUC, OMRON, DELTA, SIEMENS, MITSUBISHI, SCHNEIDER, and MESSUNG)

    PLC training in chennai
    Automation training in chennai
    Best plc training in chennai
    PLC SCADA training in chennai
    Process automation training in chennai
    Final year eee projects in chennai
    VLSI training in chennai

  5. Social media now has to be an integrated part of most businesses internal and external communications plans. A brand is no longer what we tell the customer it is – it’s what customers tell each other it is.
    If your objective is to generate sales and leads through your social media efforts, then we expect our social media training to help you achieve just that.
    Digital marketing

  6. This is an awesome post. Really very informative contents. These in a way to enhance our knowledge. Excellent post. Our Digital Marketing Training is tailored for beginners who want to learn how to stand out digitally, whether it is for their own business or a personal brand.

    Digital Marketing Course
    Digital Marketing Online Course
    Digital Marketing Course Online
    Online Digital Marketing Course
    Digital Media Marketing Course
    Digital Marketing Course Syllabus
    Marketing Digital Course

  7. I think this article will fully complement you article. PLease continue publishing helpful topics like this. Regards, from Always Open Commerce

  8. Wiztech Automation Research and Development Unit, is one of front line training organizations in Kerala. Started in the year 2006, Wiztech is on the verge of completing one decade in the field of training in industrial automation. Wiztech Automation is focused on imparting quality training to the newly graduated engineers and also those employed in industrial units, who look for skill up-gradation. Being an IAO and ISO certified organization; the company's directors have been focusing on the mission to engage their time and energies to develop facilities for providing quality training to inculcate employable engineering skills.

    PLC training in Cochin, Kerala
    Automation training in Cochin, Kerala
    Embedded System training in Cochin, Kerala
    VLSI training in Cochin, Kerala
    PLC training institute in Cochin, Kerala
    Embedded training in Cochin, Kerala
    Best plc training in Cochin, Kerala

  9. It’s a very good artical and good creation and good information thanks for sharing
    Best Social Media courses in Chennai

  10. It’s a very good artical and good creation and good information thanks for sharing
    The one of Best Social Media Marketing Workshop in Chennai

  11. Thanks for such a knowledgeable post.We provide Best SEO services in chennai, India.
    please visit:
    digital marketing classes in chennai

  12. Thanks for such a knowledgeable post.We provide Best SEO services in chennai, India.
    please visit:
    digital marketing classes in chennai

  13. Thanks for such a knowledgeable post.We provide Best SEO services in Chennai
    digital marketing classes in chennai

  14. Great blog created by you. I read your blog, its best and useful information. You have done a great work. Super blogging and keep it up.php jobs in hyderabad.

  15. Good bloger very usefull information thanks for this grate information Best of Social Media Workshop in Chennai

  16. Really awesome blog. Your blog is really useful for me. Thanks for sharing this informative blog. Keep update your blog
    Best digital marketing workshop in chennai

  17. Nice information and good matter that is so usefull thanks for sharing
    Best of Social Media training in Chennai

  18. Thanks for sharing about digital marketing,your blog always brought some useful information,i hope you will share more article like that...
    digital marketing classes in chennai

  19. It’s grate too good information thank you so much for sharing. Best Social Media Workshop in Chennai

  20. Thanks for such a knowledgeable post.We provide Best SEO services in Chennai
    digital marketing classes in chennai

  21. Usually I never comment on blogs but your article is so convincing that I never stop myself to say something about it. You’re doing a great job Keep it up.
    Best of Social Media training in Chennai

  22. Web Pixel World is a web development company in Dehradun India and a most perfect place for the PHP training in Dehradun.
    We provide PHP training in Dehradun on live projects so that the students can understand the working style and practical knowledge of PHP.

  23. Gaining Python certifications will validate your skills and advance your career.
    python certification

  24. Nice blog, thanks for sharing with us this informative blog. Visit our page for web design services.
    Hong Kong Honeymoon Packages

  25. Wow!!Great post. Thanks for sharing this informative article. Keep it up.
    iNeedTrip provides best tour packages from India to different International destinations for Honeymoon & Holidays.
    Best Travel Company in Ghaziabad
    Travel Agents in Ghaziabad
    Bali Tour Packages
    Singapore Tour Packages
    Mauritius Tour Packages
    Maldives Tour Packages
    Dubai Tour Packages

  26. We are a SEO Company in Chennai, our SEO experts have good years of experience with tried & tested techniques to rank your website. So, if you are looking for a SEM Company in Chennai feel free to contact us.

  27. We are one among the best web design company in chennai. Our objective is to deliver clients with trending solutions that add values to their webpages and applications.We are Professional Website Design Services and we have efficient team of experts who are keen to complete the project within specified period. Our HTML5 developers are up to date in latest designing tools and technologies to build interactive websites.If you are looking for web designing services in chennai also you can hire web designer india we are here to help you.

  28. This professional hacker is absolutely reliable and I strongly recommend him for any type of hack you require. I know this because I have hired him severally for various hacks and he has never disappointed me nor any of my friends who have hired him too, he can help you with any of the following hacks:

    -Phone hacks (remotely)
    -Credit repair
    -Bitcoin recovery (any cryptocurrency)
    -Make money from home (USA only)
    -Social media hacks
    -Website hacks
    -Erase criminal records (USA & Canada only)
    -Grade change
    -funds recovery

    Email: onlineghosthacker247@ gmail .com