Create real-time deepfake responses of a person using their photo, audio sample, and their bio + Q/A.
It's quite obvious to me that clones like these will be common at some point in the future. It will be a huge industry:
- Talk to ancestors
- "Reincarnation" of sorts
- Yourself, as an agent
- Dating speed runs
- Modern-day answering machines
Now ask yourself, do you want Meta to be the one cloning you? Do you want to give all of your information over to some company in the typical way? They pay you lip service while collecting your data and using it however they want. That sounds awful and deeply disrespectful when the subject matter is one's identity. Therefore, I propose OpenClone. Data is fully exportable and user-owned, privacy is the default, and the code is open source.
OpenClone is a platform. The basics are taken care of:
- Accounts and Authorization
- Microservice Architecture
- Complete ASP.NET/React website pattern
- Base Entity Framework data model ready for expansion
- Real-time rich-text logging framework
The base logic of OpenClone looks like this:
- Website - OpenClone's interface and logic.
- Database - Contains an application database, a logging database, and environment bootstrap functionality.
- SadTalker - A REST API wrapped around the SadTalker (https://github.com/OpenTalker/SadTalker) deepfake project.
- U-2-Net - A REST API wrapped around the U-2-Net (https://github.com/xuebinqin/U-2-Net) background remover project.
- Logging - LogWeaver (Python) and OpenClone.Core.Logging (C#) log to the same database. Viewable in real time with LogViewer.
- Deployment - Can be deployed as a Vultr Kubernetes cluster or self-hosted.
- Start/Stop Scripts - Batch scripts make it easy to turn the various applications on.
- Set environment variables
- Run
StartStopScripts/Database/restore.batto setup environment - Run
StartStopScripts/run-all.batto start everything
Claude has special OpenClone integrations defined in its various CLAUDE.md files:
- Claude can see your most recent screenshot.
- Ask Claude to summarize what you worked on to Session Memory. It's sort of like the story of your application. This feature was added late in the development of OpenClone so most of the "story" is not there.
- StartStopScripts/Claude/start.bat will launch Claude along with a shared tmux terminal for pair programming.
- Nested CLAUDE.md files provide knowledge about each project
For simplicity, I have told you a few lies.





