you2idea@video:~$ watch UTziRyMzkO0 [13:46]
// transcript — 181 segments
0:02 the world of AI generative video just keeps getting crazier and crazier with
0:05 new announcements coming out all the time really cool research and more and
0:10 more flexibility and controllability over the videos we create it's crazy cuz
0:14 some of the predictions that I made in this 2024 predictions video have already
0:19 come true and there's one prediction I made that I couldn't have been further
0:25 off on I don't think in 20124 I could be wrong but I don't think in 2024 we're
0:29 going to have that I type in a prompt and it's going to spit out a 30-minute
0:32 episode of South Park for me I don't think we're going to see that in 2024
0:36 but I do think we're going to see some much higher quality AI video along with
0:42 a lot longer Generations in that higher quality I posted that video on January
0:48 2nd 2024 and on January 23rd just 3 weeks later I completely changed my
0:53 stance and course corrected and said I was wrong in my 2024 predictions video I
0:57 made a comment that I don't think AI is going to be creating fulllength shows
1:02 and films this year 30 to 60 Minute stories that were coherent and enjoyable
1:06 won't be available this year I was wrong the next 2 months will be wild that was
1:11 January 23rd I'm recording this on February 28th one month later and here
1:17 we are people's minds are getting blown by AI video when I made this tweet I
1:22 wasn't referring to any one specific tool it was just a handful of things I
1:27 had gotten sneak peeks of and now most of them except for I think one of them
1:31 has been red so there's still one tool yet to come in the AI video space that
1:36 I've seen behind the scenes but haven't been able to talk about yet and still
1:39 can't but I think everything else that we're seeing right now is crazy
1:42 impressive so this is going to be a pretty quick video I just want to do a
1:47 rundown of what we've seen in the AI video space and what we can now or
1:52 almost do that we weren't able to do two months ago when I made my predictions
1:56 video starting with Sora Sora is the obvious one right it came out recently
2:01 and just blew everybody's Minds with the realism and the ability to do longer
2:06 Generation videos and how it seemed to properly follow the laws of physics
2:10 which a lot of the other AI video generators kind of didn't very well also
2:15 this week P Labs rolled out a new feature for their AI video generation
2:20 tool called lipsync which allows you to actually make your AI generated videos
2:26 talk you can actually upload audio files and it will move the mouse to what the
2:30 character is saying well still continuing to do an animation that you
2:34 had it generate and they look pretty good and if you have a pro account at
2:39 Pika you can head over to p. art and when you go to generate a video you'll
2:43 see a new option that says lip sync on your video I can take this video here
2:47 that I made of Tom Hanks playing basketball click edit on it click the
2:51 lip sync button here and then I can either input text or even upload an
2:55 audio file that I recorded let's make the voice Dave and say I love basketball
3:01 and and click generate voice I love basketball doesn't really sound like Tom
3:05 Hanks but let's roll with it and attach and continue and we get a video that
3:09 looks like this I love basketball not the best lipstick I've ever seen but
3:14 we've come a long way and uh this is the worst it's ever going to get but the
3:18 same week we got this we also got some research out of Alibaba group called emo
3:23 emote portrait alive generating expressive portrait videos with audio to
3:27 video diffusion model under weak conditions this really blew my mind so
3:32 check this out they gave this input image they gave a song with this input
3:38 image and this is what came out of it I never knew you were waiting for me now I don't want to
3:47 play too much of these songs cuz I'm sure it's copyrighted music and this
3:51 video will get demonetized but it is really really impressive there's another
3:55 example of an input image that was given a vocal sample from maramara here was
3:59 also inputed and this is the out put result yeah I think this is right now an
4:04 inflection point where we're sort of you know redefining how we interact with
4:10 with uh digital information and what's really impressive about this is yes the
4:15 lip sync is really really good but the emotions on their face and the movement
4:19 of their head as they're talking is the most realistic we've seen so far here's
4:24 another example watch how much movement there is in the heads and the blinking
4:28 And the emotions really match her singing so check this out talk to myself
4:32 for hours say things you don't understand again don't want to play too
4:41 long of a clip I'm already probably treading on thin ice with what I've
4:44 shown already this was the one that I think was the most impressive to me
4:48 because as this image of a girl was notice how as she's singing These higher
5:06 longer notes she's closing her eyes as she sings this was all just AI generated
5:11 just an image and the song and it picked up on the emotions that should be
5:14 conveyed while singing this song and I'll link up to this page in the
5:17 description because it is really cool and there are a lot of examples here I'm
5:22 just sort of avoiding playing too many of them because a lot of it I think is
5:26 using copyrighted music so if you're watching this video down the line and
5:30 the videos I just played are Ed for whatever reason that's because YouTube
5:34 decided I can't play those songs unfortunately but again I will link this
5:37 up in the description so you can go check out these videos directly from the
5:42 source this again is called emo it is really impressive like this is one of
5:46 the things that came out recently that's really blown me away the news came out
5:50 this week also that stability partnered with more Studios to make this AI film
5:55 making platform here this one's interesting because more Studio has its
5:59 own text to video model and and stability AI also has their own textto
6:04 video model in stable video diffusion but what really makes this one Stand Out
6:09 is this sort of storyboard visual drag and drop Builder that they have where
6:13 you can have a whole bunch of video shots created and then you kind of
6:17 string them together and then export them into a longer video you can see
6:21 here they took a 3se second clip a 3se second clip strung them together into a
6:25 6sec clip morph calls the process of generating editing and crosscutting a
6:29 workflow users can share their unique production workflow in Morse Creator
6:33 Community where others can replicate and modify the templates simply by changing
6:38 the AI prompts so it seems like a very similar sort of thing to like comfy UI
6:43 looks quite a bit less complex than comfy UI but a similar sort of visual
6:47 workflow we also got the announcement of LTX Studio this week now this is a tool
6:53 made by L Trix the company behind motion leap video leap photo leap really really
6:58 popular mobile video and image editing software this is sort of an all-in-one
7:03 video creation platform using AI you give it a prompt like a futuristic space
7:09 drama or NYC courtroom drama and it will create an entire storyboard of generated
7:16 videos for an entire film and Below each scene in the video you can see the
7:21 prompt that was used to generate that scene and you can get in and tweak every
7:26 single shot every single scene in the video one by one if you'd like or let it
7:31 generate all the scenes for you this is really capable of generating entire
7:36 movies from a prompt and it's not using stock footage it's generating every
7:41 scene with the AI it's also capable of creating the music the dialogue the
7:45 sound effects you can make any sort of edits you want like can we make the car
7:49 red and then it makes the same shot as the original but now the car is red and
7:54 when the storyboards all complete you can just drag and drop scenes around to
7:59 put your video together LTX Studio studio also Prides itself on character
8:03 consistency this is one of the big differentiators and selling points of
8:07 this platform is that once you get a character dialed in you obviously want
8:11 it to look like the same character in all the future scenes well this
8:14 platform's designed to do that as well you can customize the lighting and
8:19 pretty much do everything from A to Z when you have an idea for a video you
8:22 rearrange it you dial it in the way you want you change characters you change
8:26 lighting you change scenes you can make a whole movie with this single platform
8:31 I'm not going to go too much deeper into this one because LTX studio is a company
8:35 that I am going to be working with in the future so you will see me talk about
8:40 it in more videos they actually didn't pay me to sponsor this video or anything
8:43 like that but they did pay to sponsor future videos so you will see a lot more
8:48 about LTX Studio on future videos there's also a group of AI animators
8:54 that put together a Terminator to remake using entirely AI generated video clips
8:59 you can see some shots here on their Twitter of what this is going to look
9:04 like and you can see it's all AI generated scenes trying to remake
9:09 Terminator 2 and they're going all out with this one they're actually
9:13 premiering it in Hollywood on March 6th doing a live stream with the cast and
9:17 crew on March 9th and they also put together some behind the scenes content
9:21 so if you want to know how it's made they're going to be showing you how it
9:25 was made as well pretty cool to see a fulllength movie come together now this
9:30 wasn't a quickly thrown together AI generated video you can tell they spent
9:34 a lot of time getting the exact right scenes for it and dialing it in the way
9:38 you want this doesn't look like it was an easy AI video to make but it should
9:44 be interesting to see how it's received after seeing what tools like Sora and
9:49 that emo research and what LTX Studio are capable of this style of AI
9:53 animation is almost already starting to feel a little bit archaic if I'm honest
9:57 but as we always say this is as bad as it's ever going to get and some body's
10:01 got to make this first AI generated movie or remake and this is the first
10:07 one but I only imagine future iterations of movies like this are going to be
10:10 better and better and better with the technology that we have rolling out and
10:14 one last cool thing that I wanted to show off before I wrap this one up is
10:19 that this company anamorph created this generative technology that can reorder
10:23 scenes to create unlimited versions of one film the guys over at anamorph put
10:29 together a movie all about the the visual artist Brian Eno they had 500
10:35 hours of restored archival footage and interviews as well as animated visuals
10:39 and music so anamorph is able to take all of that footage and generate a new
10:45 version of the movie every single time somebody watches that movie it says
10:48 anamorph system is able to generate billions of potential sequences
10:53 resulting in a unique viewing experience for each audience you can still have an
10:57 engaging narrative Arc in a film sort of what we expect when we see a normal
11:01 documentary even if the scenes footage music and the sequences change we can
11:05 still get an engaging cohesive story it also helps that the first and last
11:09 scenes of Eno are always the same plus there are certain scenes pinned to the
11:13 same time slot in each version including the scene where Eno discusses generative
11:18 art so with their video they made an intro an ending and then had certain
11:22 scenes that they wanted to make sure absolutely showed up in every variation
11:25 of the film and then the whole rest of the film was just pulling from the
11:29 footage that they had available and generating a new film for every single
11:33 audience that watched it every audience got a completely different experience
11:36 I'm sure at some point this will be put online so others can watch it and every
11:41 person viewing it every new experience is going to be a slightly different
11:45 experience than anybody else who watched that same film got pretty interesting
11:49 pretty different take on film and what generative AI can do for the film
11:53 industry who knows maybe in the future we're going to have this movieo
11:57 experience where we go to see a new movie and everybody sees a slightly
12:01 different variation of the movie that could also really up the rewatch value
12:06 because if you watch a movie and when you watch it again the second time the
12:10 movie could be completely different than the first time well you have incentive
12:14 to watch that movie again that'd be really cool on YouTube videos actually
12:18 anyway I feel like this is a exciting Innovative sort of Novel use of this
12:22 technology and I'm excited to see how it plays out all that to say I was totally
12:28 wrong we will see more and more crazy amazing videos coming out generated by
12:34 AI in 2024 including longer and longer form videos that are actually videos
12:38 people want to watch I'm absolutely convinced of that now and based on some
12:43 of the research and Technology we're seeing roll out right now maybe I
12:46 convince some of you as well I think it's going to be a really exciting year
12:50 regardless and I'm totally here for it you want to follow along to what's going
12:55 on in the world of ai ai news AI tech gadgets Ai and film chat Bots all the
12:59 good stuff stuff make sure you're subscribed to this Channel and you like
13:02 this video and I'll make sure more videos like this show up in your feed
13:05 also if you haven't already check out futur tools. this is where I curate all
13:10 of the coolest tools in the AI world as they come out as well as keep you up to
13:14 date on all of the latest AI news there's a free newsletter Here sign up
13:17 for the free newsletter and I'll hook you up with the awesome database of
13:22 interesting ways to make money with AI and you'll also be subscribed to the
13:25 Future tools newsletter where I will keep you in the loop with just the most
13:28 interesting tools the most interesting news just the cream of the crop the best
13:33 of the best for each week that you're going to want to know about so check
13:37 that all out at Future tools. and I really appreciate you tuning in and
13:42 hanging out and nering out about cool AI stuff with me I really appreciate you
$

I Was Wrong About AI Video...

@mreflow 13:46 10 chapters
[AI agents and automation][community building and audience growth]
// chapters
// description

In this video I talk about all of the latest advancements in the world of AI Video Generation. Discover More From Me: 🛠️ Explore hundreds of AI Tools: https://futuretools.io/ 📰 Weekly Newsletter: https://www.futuretools.io/newsletter 😊 Discord Community: https://futuretools.io/discord 🐤 Follow me on Twitter: https://twitter.com/mreflow 🧵 Follow me on Instagram: https://www.instagram.com/mr.eflow 🐺 My personal blog: https://mattwolfe.com/ (Currently Being Overhauled) Resources From Today's Vide

now: 0:00
// tags
[AI agents and automation][community building and audience growth]