Just as Mark Zuckerberg recently took inspiration from Elon Musk’s playbook, unveiling paid subscriptions for verified accounts, will he now take a leap towards safeguarding valuable data on this fresh platform? 

Meta recently announced that it will be launching its Instagram Threads pretty soon. This comes just a few days after Elon Musk announced a limit on how many posts a user can read per day. The question one can ask is will Mark Zuckerberg follow suit to limit the number of post users can view on Thread to save the valuable data? 

Tech giants have aspired in recent times to create their own generative AI chatbot similar to Open AI’s ChatGPT. For any company that aspires to dive into the field of creating any form of chatbot it needs data to train its LLM. Simply put, data is like a gold mine.

The explanation that Musk gave on putting a cap on viewing was “address extreme levels of data scraping and system manipulation”. There is a speculation that Musk might plan to build its own ChatGPT rival using Twitter data – which some are referring to as TruthGPT.

Currently, Google probably has the highest amount of data as compared to any other competitor out there. Google DeepMind chief Demis Hassabis, recently claimed that the company’s next LLM project is going to eclipse ChatGPT. This huge claim is about the project called Gemini

Interestingly, DeepMind with Google has something that no one else has – YouTube. While Twitter is filled with textual data, YouTube is a gold mine for visual, audio, and textual data in almost every single language on Earth. 

What About Meta? 

One fascinating fact about Meta is that it does not use the data it collects over its applications to train its LLM LLaMa. According to research paper “LLaMA: Open and Efficient Foundation Language Models”, Llama is trained on CommonCrawl, Github, Wikipedia,and Books.

However, there is a possibility that in the future, Meta might train its LLM models (LLaMA and beyond) from Facebook and Instagram data. Again, there is also possibility that they don’t have to as they are betting big on self-supervised learning (SSL) and world models, which limits the use of RLHF (reinforcement learning with human feedback), and reduces the reliance on training models on user data. 

Recently, Meta collaborated with Carnegie Mellon University, University of Southern California to make LIMA. Unlike ChatGPT and Bard, where RLHF is considered crucial, this model may be using self-supervised learning, which has been strongly advocated by Yann LeCun for a long time.

Meta Bets Big on Open AI

Instead of making LLaMA, the chatbot, available to the general public, Meta chose a different approach. They released it as an open-source package, which means that members of the AI community can request access to it. 

Whether  the future of AI is open or closed source in itself is a different debate but by releasing LLaMA Meta took a stand of democratising access to large language models, helping  researchers advance their work in this subfield of AI.

One of the possibilities of  why Meta is backing open source is that it is nowhere near Google or OpenAI. It gives them the opportunity to correct the flaws and loopholes in LLaMA and keep an eye on how the community is bettering it. 

In the recent podcast with Lex Fridman, Mark Zuckerberg said, “The stage we are in right now, the equities balance strongly in my view towards doing this more openly.” 

Zuckerberg has shifted its focus to generative AI. He said that Meta will bring LLM powered AI agents to Messenger and WhatsApp first, but explore additional opportunities across its family of apps, consumer products and into the metaverse.

Whether Meta will venture into its own chatbot only time will tell. Zuckerberg in a Facebook post speaking on generative AI said that “We have a lot of foundational work to do before getting to the really futuristic experiences, but I’m excited about all of the new things we’ll build along the way”.

How Meta will leverage Threads’s data apart from selling it to the advertisers would be very interesting. Only time will tell if Meta will restrict data scraping. Also, the Threads has been marketed as an Instagram app by the company, where there are high chances of them following the Twitter route, challenging Musk in the real tech battle.  

The post Elon Musk vs Mark Zukerberg: The Real Tech Battle Begins  appeared first on Analytics India Magazine.