2024 is just weeks from ending, and a surge in new open source generative AI launches highlights the state of the rapidly advancing field, and growing interest among the general populace.
Be it the increasingly advanced large language models, image generators, or video generators. Organizations across the world are pushing each other to redefine the boundaries of what's possible.
We recently saw IBM introduce an AI-powered document extraction tool called Docling. Not long after that, a group of researchers from Beijing announced a novel open source model called OmniGen that makes image editing via prompts effortless.
Now, we have yet another organization pushing the frontier of open source AI who have launched a new model for videos called LTX Video (LTXV).
LTXV: What To Expect?
Credit: Lightricks/VentureBeat
Introduced by Lightricks, a tech company out of Israel, LTXV is an open source DiT-based (diffusion transformer) AI model that can be used to generate high-grade videos quickly, depending on the hardware used.
LTXV is distributed under Apache License 2.0 and has been trained on large-scale datasets of videos. There are many things to like about it:
- Can be used for long-form video production.
- Is optimized for GPU and TPU-equipped systems.
- Ensures coherence between frames, preventing issues like flickering.
The video shown above is a prime example of what LXTV can do. The text prompt was to create a high-fashion scene. LXTV generated a video with a businesswoman in the financial district of a city going about her business while soothing audio was being played in the background.
That video was generated in just four seconds on NVIDIA H100 GPUs. The developers have ensured that this runs well on consumer-grade hardware too, offering up swift video generations.
Of course, your mileage may vary depending on the hardware configuration of your system. But you can still give it a shot.
Want To Check It Out?
For more details on LTXV, you can head to the official website, where you will find relevant information on the model. If you are looking to deploy it on your system, then the documentation and Hugging Face pages for Lightricks should be your next stops.
The GitHub repo is also handy for those looking to dive in deeper, and there are live demos of the model on Hugging Face Playground and fal.ai.
At the time of writing, the technical documentation for LTXV was still not out, but you can keep an eye out on the documentation page linked above.
Via: VentureBeat
Suggested Read 📖
Sourav Rudra
Here's why you should opt for It's FOSS Plus Membership
- Even the biggest players in the Linux world don't care about desktop Linux users. We do.
- We don't put content behind paywall. Your support keeps it open for everyone. Think of it like 'pay it forward'.
- Don't like ads? With the Plus membership, you get an ad-free reading experience.
- When millions of AI-generated content is being published daily, you read and learn from real human Linux users.
- It costs just $2 a month, less than the cost of your favorite burger.
