Uncover the Secrets of Apple's ChatGPT Integration
Using ChatGPT without an Account through Apple's Integrations
After Apple's seamless integration of OpenAI's ChatGPT into iOS 18, iPadOS 18, and macOS Sequoia, OpenAI has laid out in detail how your data is managed. When using ChatGPT through these integrations without logging into a ChatGPT account, you gain access to certain features. OpenAI emphasizes that it does not receive your IP address, nor does it store your requests for the purpose of training its AI models. Your conversations are merely processed by OpenAI to ensure a safe response and compliance with the law. However, if you decide to continue a conversation initially started through an Apple integration in the ChatGPT app or website, OpenAI then follows its privacy policy and gains access to additional information such as your IP address, browser type and settings, request date and time, time zone, country, and device information. Additionally, OpenAI uses online analytics tools with cookies to analyze user interactions with ChatGPT.It's important to note that this approach provides a certain level of privacy while still allowing users to enjoy the benefits of ChatGPT through Apple's integrations. It gives users the option to use the service without sharing extensive personal data.
For those who value their privacy and want to limit the amount of data shared, using ChatGPT without an account through Apple's integrations can be a suitable choice.
Using ChatGPT with an Account through Apple's Integrations
When you connect your ChatGPT account to Apple's integrations, your existing data preferences with OpenAI come into play. For example, if your settings indicate that you want your conversations to be saved, then your interactions with ChatGPT through Apple's integrations will also be saved in your account's chat history. This allows you to access them later with ease. Moreover, if your ChatGPT settings prohibit the use of your conversations for training OpenAI's models, the same rule applies to your interactions through Apple's integrations.Once you connect your account, OpenAI makes some information about your ChatGPT account available on your device to facilitate the connection. This includes details such as your name, email address, profile image, workspace names, and billing plan.By connecting your account, you can enjoy a more personalized experience and have greater control over how your data is handled. It also enables seamless integration between different platforms and services.
However, it's crucial to be aware of the implications and ensure that your privacy settings are configured according to your preferences.
Unlock the Potential of Real-time Video-based Conversational AI
Initial Focus on Vertical Markets
eSelf's initial focus is on various verticals including education, sales, financial services, real estate, and health and wellness. These verticals present unique opportunities for the development and application of real-time video-based conversational AI agents. By targeting these specific industries, eSelf aims to provide tailored solutions that meet the specific needs of each sector.For example, in the education sector, these agents can assist students with their studies, provide answers to questions, and offer personalized learning experiences. In sales, they can help sales representatives engage with potential customers, provide product information, and schedule appointments. In financial services, they can offer financial advice, help with account management, and provide real-time market information. In real estate, they can assist with property searches, provide property details, and schedule viewings. And in health and wellness, they can offer health advice, provide information about medical conditions, and schedule appointments with healthcare providers.
Faster Query/Interaction Response Time
One of eSelf's early pitches is that its agents' current query/interaction response time is under 1.7 seconds. This is claimed to be faster than voice responses from other leading companies like OpenAI, making the interactions more lifelike. The startup has launched a "no-code" creation studio that allows its customers to build their own agents. These agents can operate common apps such as Calendly, Salesforce, and others to schedule appointments, access collateral content, and reference data just as a human assistant might do.For instance, when a customer schedules an appointment using an eSelf agent, the agent can seamlessly integrate with Calendly to find available time slots and schedule the appointment. Similarly, when a customer needs access to collateral content, the agent can quickly access and provide the relevant information from Salesforce or other apps. This seamless integration and fast response time enhance the user experience and make the interactions more efficient.
Powering Millions of Real-time Conversations
eSelf claims to have powered "millions" of real-time conversations in stealth mode. Current customers include Christie's real estate and Brazilian bank AGI. These successful deployments demonstrate the potential and effectiveness of eSelf's real-time video-based conversational AI agents.For example, in Christie's real estate, the eSelf agent can assist potential buyers with property searches, provide detailed property information, and schedule viewings. In Brazilian bank AGI, the agent can help customers with account management, provide financial advice, and handle various banking transactions. These real-world examples showcase the practical applications and value of eSelf's technology.
Unlikely Origin Story
eSelf is co-founded by Dr Alan Bekker (CEO) and Eylon Shoshan (CTO), and it has an interesting origin story. Bekker, who lives in Tel Aviv, originally wanted to become a rabbi. However, after approaching the chief rabbi in his school and not getting satisfactory answers to his big questions about God and faith, he decided to drop out of rabbinical school and pursue a career in engineering, physics, and computer science.He had a longstanding interest in math and signed up for a course in machine learning by mistake. This course gave him a glimpse into another kind of omniscience, where he realized that with mathematics, one can understand natural language, vision, and speech. This discovery sparked his passion for understanding humans and the world.
First Startup and Acquisition by Snap
Bekker's first startup was Voca, which focused on building AI voice assistants for call centers. It attracted large customers like American Express and TNT (now a part of FedEx). Eventually, Snap acquired Voca in 2020 for $100 million, although the details of how the tech would be used were unclear.Bekker then took on a role as the head of Conversational AI at Snap and led a team in building conversational AI tech. However, it took almost three years and the arrival of generative AI for this technology to find a landing point in a product. By the time Snapchat launched My AI in 2023, Bekker had already left the company.
Co-founding eSelf and Targeting the "Agentic" Opportunity
Meanwhile, Bekker teamed up with Eylon Shoshan to co-found eSelf. In a world where the tech industry is becoming crowded with companies targeting the "agentic" opportunity, eSelf aims to stand out by offering more interactive and humanlike products using video and voice in the response.By tapping into advances in Generative AI, eSelf is creating building blocks to craft agents that can carry out various tasks. Startups and established players like Salesforce are also coming out with agents for specific use cases. It's early days, but it will be interesting to see which of these startups land investors and gain traction with paying users.
Model Building and Training
One of the significant challenges in the development of real-time video-based conversational AI agents is the building and training of models. Bekker said that eSelf has not built its own LLMs from scratch but has fine-tuned Meta-created Llama models. This approach allows customers who already have chatbots built on platforms like GPT to switch to using eSelf's technology with relatively lower latency.By fine-tuning existing models, eSelf can leverage the advancements in machine learning and natural language processing while reducing the time and resources required for model building. This approach also enables eSelf to offer a more cost-effective solution for customers looking to build and operate real-time video-based conversational AI agents.
Stay Informed with TechCrunch's AI Newsletter
News
In the world of AI, there are always exciting developments happening. This week, we bring you a roundup of the most notable news:
Image Credits: Kirillm / Getty Images
A test for AGI is getting close to being solved, but it points to flaws in the test's design rather than a breakthrough. Amazon is establishing a new R&D lab in San Francisco focused on building "foundational" capabilities for AI agents. OpenAI's video generator, Sora, is now available to most ChatGPT Pro and Plus subscribers, while those in Europe are out of luck. China has opened an antitrust probe into Nvidia's acquisition of Mellanox. Yelp has released AI-powered review insights to analyze sentiment and highlight categories. Google has signed a deal to spin up carbon-free power for data centers. Reddit has debuted Reddit Answers, a conversational AI feature. X (formerly Twitter) has a new image generator, Aurora, tuned for photorealistic rendering.
Research paper of the week:
Image Credits: Bryce Durbin / TechCrunch
A team from Ai2 and UC San Diego has created an AI model that can predict 100 years of climate patterns in 25 hours. Called Spherical Dyffusion, it starts with basic climate science knowledge and applies transformations. It can run on modest hardware and has limitations, but the researchers plan to refine it. Ai2 also released the second generation of its climate-modeling AI, Climate Emulator.
Model of the week
Sora is getting attention, but a new video-generating model from MIT CSAIL and Adobe Research is potentially more exciting. Called CausVid, it can start playing videos as it generates them, providing a preview. The researchers plan to release an open source implementation soon.
Grab bag:
The group that leaked access to Sora last November has published essays explaining their actions. They wanted to denounce the exploitation of creatives for R&D and PR. As they wrote in a post, "We called on artists to think beyond proprietary systems and the limitations of prompting a model mediated by big tech."
As always, we're open to your feedback. Drop us a line with your thoughts anytime.