Give this AI one normal phone video, and it predicts what the person looks like from angles the camera never captured.
4DAnyone is the video generator that takes a single casual phone clip and turns it into a fully explorable four-dimensional character. You do not need a special camera rig or expensive studio setup to capture someone moving in three dimensions. This tool accepts one standard video of a person and predicts how they look from every possible angle, including views from above, behind, and around them. It handles the tricky work of matching the motion and lighting so the generated angles look consistent. Once you have those multiple views, you can feed them into standard reconstruction tools to build a realistic digital twin.
Open source: ant-research/4danyone
Follow for more open source project drops.
#4DGeneration #ComputerVision #GenerativeAI
Transcription
4D Anyone is the video generator that takes a single, casual phone clip and turns it into a fully explorable four-dimensional character. You do not need a special camera rig or expensive studio setup to capture someone moving in three dimensions. This tool accepts one standard video of a person and predicts how they look from every possible angle, including views from above, behind and around them. It handles the tricky work of matching the motion and lighting, so the generated angles look consistent. Once you have those multiple views, you can feed them into standard reconstruction tools to build a realistic digital twin.
Voir la source originale