OpenAI unveiled revolutionary latest software that may produce high-caliber video in response to just a few easy text queries — a stunning breakthrough from the ChatGPT maker that would also take concerns about deepfakes and rip-offs of licensed content to a latest level.
The technology, called Sora, uses its “deep understanding of language” to create clips of as much as one-minute long that include “compelling characters” and “multiple shots inside a single generated video,” the company said on an internet site dedicated to the brand new tech.
“Sora is in a position to generate complex scenes with multiple characters, specific varieties of motion and accurate details of the topic and background,” OpenAI said. “The model understands not only what the user has asked for within the prompt, but additionally how those things exist within the physical world.”
The Sam Altman-led firm provided just a few stunning examples from prompts that were seemingly written for a Hollywood script, based on tech outlet Wired, which was given a sneak peek at Sora’s capabilities.
“Beautiful, snowy Tokyo city is bustling. The camera moves through the bustling city street, following several people having fun with the attractive snowy weather and shopping at nearby stalls. Gorgeous sakura petals are flying through the wind together with snowflakes,” the prompt read.
Sora turned the three sentences right into a vibrant 17-second video — well in need of the one-minute limit — that rendered a nondescript couple holding hands while walking along a snow-covered street lined with pagoda-topped shops with the Tokyo skyline in the space.
Cherry blossoms (sakura) were in full bloom as snow fell from the overcast sky.
There have been just a few bugs, just like the sidewalk coming to a dead end, but overall it was “a mind-blowing exercise in world-building,” Wired wrote.
“The present model has weaknesses. It might struggle with accurately simulating the physics of a fancy scene, and will not understand specific instances of cause and effect,” OpenAI said.
“For instance, an individual might take a bite out of a cookie, but afterward, the cookie may not have a bite mark.”
Nevertheless, one other jaw-dropping example got here from a prompt that requested “an animated scene of a brief fluffy monster kneeling beside a red candle” who had “wide eyes and open mouth.”
The result was a mashup of a Furby with a gremlin that created a cuddly creature suitable for Pixar’s “Monsters, Inc.” franchise. The convenience with which Sora rendered the character belied the time-consuming efforts it normally takes experienced animators — raising concerns concerning the impact the technology can have on the movie industry.
A future enhancement shall be the power to generate video from a still image, the corporate said.
“This shall be one other really cool method to improve storytelling capabilities,” Bill Peebles, a researcher on the project, told Wired.
“You’ll be able to draw exactly what you’ve gotten in your mind after which animate it to life.”
It wasn’t immediately clear when Sora will change into available to most of the people, or if it would be free for users.
Representatives for OpenAI didn’t immediately reply to The Post’s request for comment.
Currently, the software was released to pick creators and security experts who will “red-team” the product for security issues.
Red-teaming is a process where a group pretends to be an enemy and attempts a physical or digital intrusion against an organization.
Sora’s generative power not only threatens to upend Hollywood in the longer term, but within the near term the short-form videos pose a risk of spreading misinformation, bias and hate speech on popular social media platforms like Reels and TikTok.
The corporate has vowed to forestall the software from rendering violent scenes or deepfake porn, just like the graphic images of a nude Taylor Swift that went viral last month.
Sora also won’t appropriate real people or the form of a named artist, but its use of “publicly available” content for AI training can result in the form of legal headaches OpenAI has faced from media firms, actors and authors over copyright infringement.
“The training data is from content we’ve licensed and in addition publicly available content,” the corporate said.
OpenAI said it was developing tools which may discern if a video was generated by Sora — placating growing concerns about threats like GenAI’s potential influence on the 2024 election.
The corporate — which has a $10 billion “multiyear” agreement with Microsoft, expanding upon a partnership that began in 2019 with just $1 billion from the Big Tech firm — also ensured that it’s taking “several essential safety steps ahead of constructing Sora available in OpenAI’s products.
AI’s ability to meddle with elections have ramped up fears after the corporate released ChatGPT, which may mimic human writing convincingly, and DALL-E, whose technology will be used to create “deepfakes,” or realistic-looking images which can be fabricated.
Altman testified in Congress last May that he was “nervous” about generative AI’s ability to compromise election integrity through “one-on-one interactive disinformation.”
The San Francisco-based company said it’s working with the National Association of Secretaries of State, a company that focuses on promoting effective democratic processes comparable to elections.
ChatGPT will direct users to CanIVote.org when asked certain election-related questions, it added.
News of Sora’s forthcoming deployment follows rival Meta’s move to beef up its image generation model Emu last yr, when it added two AI-based features that may edit and generate videos from text prompts.
Google and startups like Runway have also launched text-to-video AI projects.
With Post wires.
OpenAI unveiled revolutionary latest software that may produce high-caliber video in response to just a few easy text queries — a stunning breakthrough from the ChatGPT maker that would also take concerns about deepfakes and rip-offs of licensed content to a latest level.
The technology, called Sora, uses its “deep understanding of language” to create clips of as much as one-minute long that include “compelling characters” and “multiple shots inside a single generated video,” the company said on an internet site dedicated to the brand new tech.
“Sora is in a position to generate complex scenes with multiple characters, specific varieties of motion and accurate details of the topic and background,” OpenAI said. “The model understands not only what the user has asked for within the prompt, but additionally how those things exist within the physical world.”
The Sam Altman-led firm provided just a few stunning examples from prompts that were seemingly written for a Hollywood script, based on tech outlet Wired, which was given a sneak peek at Sora’s capabilities.
“Beautiful, snowy Tokyo city is bustling. The camera moves through the bustling city street, following several people having fun with the attractive snowy weather and shopping at nearby stalls. Gorgeous sakura petals are flying through the wind together with snowflakes,” the prompt read.
Sora turned the three sentences right into a vibrant 17-second video — well in need of the one-minute limit — that rendered a nondescript couple holding hands while walking along a snow-covered street lined with pagoda-topped shops with the Tokyo skyline in the space.
Cherry blossoms (sakura) were in full bloom as snow fell from the overcast sky.
There have been just a few bugs, just like the sidewalk coming to a dead end, but overall it was “a mind-blowing exercise in world-building,” Wired wrote.
“The present model has weaknesses. It might struggle with accurately simulating the physics of a fancy scene, and will not understand specific instances of cause and effect,” OpenAI said.
“For instance, an individual might take a bite out of a cookie, but afterward, the cookie may not have a bite mark.”
Nevertheless, one other jaw-dropping example got here from a prompt that requested “an animated scene of a brief fluffy monster kneeling beside a red candle” who had “wide eyes and open mouth.”
The result was a mashup of a Furby with a gremlin that created a cuddly creature suitable for Pixar’s “Monsters, Inc.” franchise. The convenience with which Sora rendered the character belied the time-consuming efforts it normally takes experienced animators — raising concerns concerning the impact the technology can have on the movie industry.
A future enhancement shall be the power to generate video from a still image, the corporate said.
“This shall be one other really cool method to improve storytelling capabilities,” Bill Peebles, a researcher on the project, told Wired.
“You’ll be able to draw exactly what you’ve gotten in your mind after which animate it to life.”
It wasn’t immediately clear when Sora will change into available to most of the people, or if it would be free for users.
Representatives for OpenAI didn’t immediately reply to The Post’s request for comment.
Currently, the software was released to pick creators and security experts who will “red-team” the product for security issues.
Red-teaming is a process where a group pretends to be an enemy and attempts a physical or digital intrusion against an organization.
Sora’s generative power not only threatens to upend Hollywood in the longer term, but within the near term the short-form videos pose a risk of spreading misinformation, bias and hate speech on popular social media platforms like Reels and TikTok.
The corporate has vowed to forestall the software from rendering violent scenes or deepfake porn, just like the graphic images of a nude Taylor Swift that went viral last month.
Sora also won’t appropriate real people or the form of a named artist, but its use of “publicly available” content for AI training can result in the form of legal headaches OpenAI has faced from media firms, actors and authors over copyright infringement.
“The training data is from content we’ve licensed and in addition publicly available content,” the corporate said.
OpenAI said it was developing tools which may discern if a video was generated by Sora — placating growing concerns about threats like GenAI’s potential influence on the 2024 election.
The corporate — which has a $10 billion “multiyear” agreement with Microsoft, expanding upon a partnership that began in 2019 with just $1 billion from the Big Tech firm — also ensured that it’s taking “several essential safety steps ahead of constructing Sora available in OpenAI’s products.
AI’s ability to meddle with elections have ramped up fears after the corporate released ChatGPT, which may mimic human writing convincingly, and DALL-E, whose technology will be used to create “deepfakes,” or realistic-looking images which can be fabricated.
Altman testified in Congress last May that he was “nervous” about generative AI’s ability to compromise election integrity through “one-on-one interactive disinformation.”
The San Francisco-based company said it’s working with the National Association of Secretaries of State, a company that focuses on promoting effective democratic processes comparable to elections.
ChatGPT will direct users to CanIVote.org when asked certain election-related questions, it added.
News of Sora’s forthcoming deployment follows rival Meta’s move to beef up its image generation model Emu last yr, when it added two AI-based features that may edit and generate videos from text prompts.
Google and startups like Runway have also launched text-to-video AI projects.
With Post wires.
