Visualistan: ChatGPT -->

    Social Items



In its latest event, OpenAI revealed that it is launching a desktop app of ChatGPT, a new and faster model ‘GPT-4o,’ and bringing UI changes to ChatGPT on web.



ChatGPT works a little differently in the desktop app. When you open it on your desktop next to a program, ChatGPT can answer any queries related to whatever is displayed on your screen. To ask questions, you can use the Option + Space keyboard shortcut, as well as take and share screenshots with the app to obtain ChatGPT’s response. Currently, the app’s availability is only limited to ChatGPT Plus users, but it will be expanded to all users with a broader rollout in the coming weeks.

 

OpenAI Announces a New ChatGPT Desktop App for MacOS



ChatGPT has been updated with a new ‘Memory’ feature exclusively for ChatGPT Plus subscribers, that can permanently store details about users, such as their personal information, queries, prompts, and other customizations. The feature was first rolled out to a limited number of people in February of 2024.

 

The Memory feature functions in two ways: one by being asked by the user to remember specific information, and the other by self-learning from conversations, which is akin to how algorithmic systems work in apps. Once ChatGPT saves the information, it can make conversations with users more customizable without needing any reminders.

ChatGPT’s Latest Feature Remembers Users’ Information to Make Conversations More Personalized



At Snap’s latest AR event, it was revealed that Snapchat will soon be incorporating AR Lenses powered by ChatGPT. This would be possible as a result of Snapchat’s new Lens Studio launched in beta, where developers can create filters using ChatGPT.

 

These ChatGPT-powered Snapchat Lenses will work on the same AI system as ChatGPT – meaning that users will be able to ask questions within the filters to which they will receive responses. For instance, in a sample shared by Snap, a user has asked the question “How far away is Neptune?” in a solar system-themed filter, and the filter generates an answer in return. This indicates that this functionality could be specifically used to create quizzes or randomizers.

Snap Announces a New AR Lens Feature Powered by ChatGPT on Snapchat



It seems like ChatGPT is bringing a new offering for its subscribers for creating and managing chatbots. The update was leaked ahead of OpenAI’s developer event, showing images and videos of a custom chatbot creator tool.

 

More precisely, the reports show a ‘GPT Builder’ option that lets users create their own chatbot by entering a prompt. The tool is speculated to be a part of the new ChatGPT prototype ‘Gizmo V8.’

 

It includes two tabs: Create and Configure. The Create tab includes the options of selecting a default language, tone, and writing style for the bot. Within the Configure tab are settings for naming, describing, and providing instructions to the bot about what it can and can’t do. There is also an option of adding custom actions for the chatbot, as well as the ability to upload files for a bespoke knowledgebase, and toggle for web browsing and image generation.

ChatGPT May Soon be Releasing a Chatbot Creator Tool for its Subscribers



OpenAI’s latest text-to-image generator model ‘DALL-E 3’ that was first announced last month is now being launched to ChatGPT Plus and Enterprise customers. The technology will be available within the ChatGPT app, and is designed to provide more safety tools and the ability to enter longer prompts.

 

DALL-E 3 is a more efficient version of DALL-E 2, as it enables users to produce longer and more visually descriptive prompts that the bot can then use to generate images. DALL-E 3 is also available within the Bing Chat and Bing Image Generator, which means that Microsoft was the first platform to introduce a wider public access to the model, before ChatGPT could integrate it.

OpenAI Launches Access to DALL-E 3 for Paying Users of ChatGPT



ChatGPT has been updated with a new, useful functionality: the ability to ask the bot questions in the form of audio and images. Most AI models, including ChatGPT itself, were originally designed to receive and respond to questions in the form of text prompts. With further advancements, OpenAI has expanded the potential of its technology, hence the new prompting methods.

 

 

The process of entering commands or questions via audio is apparently pretty simple: the user will need to tap a button to record their query which will be automatically converted to text and processed by the chatbot. Similarly, the answer from the bot will be converted back to speech and spoken out loud for the user.


The master technology behind this speech-to-text conversion is OpenAI’s Whisper model. The company has also developed another similar model for text-to-speech conversion, that it claims can produce “human-like audio” from text, after being trained on a few seconds of sample speech. In this domain, OpenAI has even collaborated with Spotify to translate podcasts into other languages, while maintaining the original sound of the podcaster’s voice.

ChatGPT Introduces Image and Audio Formats of Asking Questions to the Bot

Subscribe Our Newsletter