Open‑Source AI Tools: One‑Click Marketing Video Generator & Hand‑Drawn Storyboard Converter

Two open‑source AI projects—short‑video‑factory, which creates product‑marketing videos from prompts and assets in a single click, and clipsketch‑ai, which converts videos into hand‑drawn storyboards and generates platform‑specific copy—are detailed with features, installation steps, tech stacks, and community reception.

Geek Labs
Geek Labs
Geek Labs
Open‑Source AI Tools: One‑Click Marketing Video Generator & Hand‑Drawn Storyboard Converter

Today we explore two open‑source AI tools for short‑video creation: short‑video‑factory , which generates product‑marketing videos with a single click, and clipsketch‑ai , which transforms videos into hand‑drawn storyboards and produces platform‑specific copy.

short‑video‑factory: One‑Click Marketing Video Generator

What it is

short‑video‑factory is a cross‑platform desktop application that simplifies short‑video production using AI. Users provide a prompt and storyboard assets, and the tool automatically edits high‑quality marketing videos.

Key capabilities

AI copy generation: automatically creates short‑video scripts from prompts.

Speech synthesis: integrates EdgeTTS, supporting Chinese, English and other languages.

Automatic editing: intelligent composition of video, audio, and subtitles with auto‑mixing.

Batch processing: preset a task and continuously generate videos.

Subtitle effects: multiple subtitle styles available.

Fully local execution: data never leaves the machine, ensuring privacy.

How to use

Download the installer for Windows, macOS or Linux from the GitHub Release page, then follow the provided manual: input prompt → select storyboard assets → AI auto‑edit → export the result.

short-video-factory interface
short-video-factory interface

Performance

The repository has earned ★ 3,747 stars, is written in TypeScript, and features a polished UI. Demonstrations show two video styles—product marketing and warm‑hearted quote videos. Users report a noticeable boost in editing efficiency, making it suitable for operators and creators who need bulk video production.

GitHub: https://github.com/YILS-LIN/short-video-factory

clipsketch‑ai: Hand‑Drawn Storyboard Converter

What it is

ClipSketch AI is an AI‑driven content‑creation workstation that extracts highlight frames from a video and converts them into a cohesive hand‑drawn storyboard, while also generating three styles of copy tailored for platforms such as Xiaohongshu.

Key capabilities

Multi‑source import: parses share links from Bilibili and Xiaohongshu.

Frame‑level precise tagging: space‑play, left/right arrow frame‑by‑frame adjustment, and T key for quick highlight marking.

Hand‑drawn storyboard generation: calls Google Gemini multimodal model to merge marked frames into a continuous storyboard.

Social copy generation: automatically creates three copy styles (emotional story, tutorial, concise).

Character fusion: upload custom avatars; AI blends them into storyboard scenes.

Cover generation: produces high‑quality vertical covers based on copy and original frames.

Batch refinement: supports bulk generation and optimization of storyboards.

How to use

Requires Node.js v18+ and a valid Google Gemini API key. After cloning the repository, install dependencies, then configure the .env.local file with the API key and run npm run dev. Docker users can pull the image for a simpler setup.

Workflow: import video link → tag highlights → AI generates storyboard → download assets or copy the generated copy.

ClipSketch AI interface
ClipSketch AI interface

Performance

The project has ★ 1,698 stars and is built with React 19, TypeScript, and Tailwind CSS. The authors note that the Gemini‑3‑pro‑image‑preview model must be accessible via the API key for the AI drawing feature. It is especially useful for creators who want to repurpose horizontal videos into vertical, Xiaohongshu‑style content.

GitHub: https://github.com/RanFeng/clipsketch-ai

Both tools address distinct pain points: bulk video production efficiency and creative style transformation for video remixing. They are free, open‑source, and ready for anyone with the relevant needs to try.

TypeScriptReActAI video generationopen-source toolsGoogle Geminiclipsketch-aiEdgeTTSshort-video-factory
Geek Labs
Written by

Geek Labs

Daily shares of interesting GitHub open-source projects. AI tools, automation gems, technical tutorials, open-source inspiration.

0 followers
Reader feedback

How this landed with the community

Sign in to like

Rate this article

Was this worth your time?

Sign in to rate
Discussion

0 Comments

Thoughtful readers leave field notes, pushback, and hard-won operational detail here.