AI creation tools for mixed reality
Meta Horizon is an immersive mixed-reality platform with thousands of games and experiences designed to bring people closer together. The Creator Success pillar expanded into the Core Creation pillar within the Horizon org, and it was there that I led content design. With the epansion came a new organizational goal: to unlock possibilities and accelerate workflows for the creators, developers, and studios who build experiences on the platform. The questions that guided our conceptualization and implementation were:
- What tools/capabilities were the people who participate in metaverse experiences looking for?
- What were our different developer audiences, and what were their individual needs?
- What were the existing offerings in the competitive landscape, if any?
Through user research, design vision sprints, and strategic planning, we decided to offer NPC (non-player character) creation capabilities, as well as genAI tooling to enhance the previous at-the-time offering. As the Pillar Lead for Meta Horizon Creation, my duties included:
- Defining the information architecture of each experience
- Creating the "Anatomy of an NPC" taxonomy, a foundational framework upon the feature was built
- Building data models for NPC voice, speech, scripting, backstory, and locomotion
- Management of the developer documentation process
- Collaborate with Privacy and Legal partners in global markets to ensure data use adherence across 11 markets
- Prompt testing and evaluation of genAI asset creation
A demo and samples of the genAI creation tools are below.
The audiences for whom we built
genAI creation tools
Creator Assistant
Style Reference
NPC Creation Tools