Hackathon Project: TomoOne Cat - The Ultimate AINFT Avatar Companion

YouTube Demo Video

Introduction

Step into the extraordinary world of TomoOne Cat - a revolutionary project that seamlessly merges AINFT avatars with immersive gaming integration. Our goal is to redefine the way we interact with virtual identities, ushering in a new era of gaming and companionship.

The Challenge

The gaming landscape often falls short in connecting players with their avatars, resulting in subpar experiences. Furthermore, the lack of interoperability limits the potential of in-game characters to transcend digital boundaries.

The Solution

TomoOne Cat - Your Dynamic AINFT Avatar Companion

Meet the enchanting TomoOne Cat - an AINFT avatar that takes personalization and interaction to unprecedented heights. Through advanced AI technology, we've brought this cat to life in a lifelike 3D model, infusing it with a distinctive personality that goes beyond mere avatars.

Unlock the Oasys and Ubisoft Universes

Our innovation doesn't stop at traditional borders. TomoOne Cat seamlessly integrates into the captivating worlds of Oasys and Ubisoft. This interoperability empowers your virtual companion to traverse various game universes while retaining its unique identity.

Key Features

1. AINFT Avatar Creation: Transform your beloved feline friend into a personalized TomoOne Cat AINFT avatar using cutting-edge AI techniques.

2. Lifelike 3D Model: Marvel at the realism of the TomoOne Cat's 3D model, brought to life by AI-driven rendering.

3. Distinct Personality: Each TomoOne Cat boasts its own distinct traits, turning every interaction into a captivating experience.

4. Oasys Integration: Immerse yourself in the wondrous realm of Oasys, where TomoOne Cat becomes an integral part of your virtual journey.

5. Ubisoft Partnership: Embark on thrilling quests within Ubisoft games with your faithful companion by your side, enriching both your gameplay and personal connection.

6. Seamless Interoperability: Our AINFT standard guarantees smooth transitions for TomoOne Cat between diverse virtual realms, revolutionizing gaming versatility.

How It Works

1. AINFT Avatar Creation: Upload an image of your cat and let our AI transform it into a unique NFT avatar.

2. Infuse Personality: AI generates distinctive personality traits for TomoOne Cat, facilitating engaging interactions.

3. Game Integration: Witness the magic as TomoOne Cat seamlessly integrates into Oasys and Ubisoft games, enhancing your virtual experiences.

4. Interoperability: TomoOne Cat's AINFT format ensures effortless movement between game worlds while preserving its individuality.

The Tech Behind It

• Frontend: User-friendly React application with HTML and CSS.
• AI: Deep Learning models for image transformation and personality generation.
• 3D Rendering: AI-driven rendering techniques for lifelike visualizations.
• Game Integration: Oasys and Ubisoft APIs for a seamless avatar experience.
• Blockchain: Ethereum network for AINFT creation and interoperability standard.

The Impact

TomoOne Cat transcends traditional avatars, leading the way for interactive AINFT companionship. This project exemplifies the immense potential of technology to elevate gaming and foster genuine connections, setting a new standard for virtual identities.

What's Next?

1. Extended Game Collaborations: Expand interoperability across more games, unlocking even more adventures for TomoOne Cat.

2. Personalized Avatars: Empower users to customize TomoOne Cat's appearance and traits, promoting creativity and individuality.

3. AI-Enhanced Conversations: Elevate your interactions with TomoOne Cat by integrating advanced AI conversational models.

Conclusion

TomoOne Cat revolutionizes the concept of AINFT avatars, ushering in a new era of interactive companionship. Join us in this journey of exploration, personalization, and seamless cross-realm connections. This isn't just about gaming - it's about embracing an AI-powered, immersive future!

Embark on a remarkable journey with TomoOne Cat, where AI and gaming unite harmoniously! 🐾🎮🌌

Video Demo

YouTube: 🌟 Minting AINFT Avatars on Oasys: An Immersive Guide! 🚀

Demo

🌟 Mint Your AINFT Avatar on AILAND 🌟

Step 1: Refill Your Wallet

1. 🛠️ Refill your Metamask wallet with testnet Oasys tokens.
2. 🔗 Visit faucet.testnet.oasys.games.
3. 📝 Follow the on-screen instructions to complete the process.

Step 2: Create Your Avatar

1. 📸 Use your selfies to make a personalized avatar.
2. 🧑‍🎨 Customize its appearance and clothes to your liking.
3. 🔍 Click 'Next' and watch for the message 'Avaturn avatar used' in the GLB input field.

Step 3: Add Personality

1. 🧠 Fill in avatar's personality details in the form.
2. 🎲 Or click 'Randomize' for an AI-generated personality.

Step 4: Choose Network

1. ⚡ Select the Oasys network from the options.

Step 5: Mint Your Avatar

1. 💎 Click 'Mint' and confirm the transaction in your Metamask wallet.

Step 6: Let the Fun Begin!

1. 🎮 Use your avatar in AILAND game for immersive interactions.
2. 💬 Engage via text or voice interactions.
3. 👾 Also use your avatar as a skin in the game for a unique experience.

Enjoy the magic of AI-powered avatars in the exciting world of AILAND! 🌈🎉🚀

Features

• Selfie to Avatar: Instantly turn your selfie into an animated avatar.

• Customization & Traits: Personalize your avatar with custom traits, such as name, bio, etc. or choose from AI-generated traits to make your avatar unique.

• Interactivity: Engage with your avatar through voice or text commands.

• Game Integration: Use your minted avatar as a skin in supported games.

• Blockchain Deployment: Mint your AINFT avatar directly to the Oasys testnet.

Prerequisites

1. Node.js & npm
2. MetaMask browser extension

Setup

1. Clone the repository:

git clone https://github.com/andreykobal/simple-nft-minter

2. Navigate to the project directory:

cd ai-nft-avatar-minting

3. Install the required packages:

npm install

4. Create a .env file in the root directory and set the REACT_APP_NFT_STORAGE_TOKEN variable with your token from NFT.Storage:

REACT_APP_NFT_STORAGE_TOKEN=YOUR_NFT_STORAGE_TOKEN

5. Run the application:

npm start

6. Build for production use

npm run build

Now, open your browser and navigate to http://localhost:3000 to see the application in action!

Code Highlights:

1. Switching To Oasys Testnet Network:

   Users have the flexibility to switch between Ethereum networks, making the platform versatile.

   async function switchToNetwork() {
       // Network configurations...
       await window.ethereum.request({
           method: 'wallet_switchEthereumChain',
           params: [{ chainId: currentNetwork.chainId }],
       });
   }

2. Minting NFTs:

   Seamless integration for minting NFTs, including error handling.

   const mintToken = async () => {
       if (window.ethereum) {
           // Uploading, metadata generation and minting...
       } else {
           alert('Ethereum not detected! Please install and setup MetaMask.');
       }
   };

3. AI-Generated Traits:

   Fetch random metadata generated by AI for the avatar's traits.

   const fetchRandomData = async () => {
       const response = await fetch("<API_URL>");
       const content = JSON.parse(data.content);
       setName(content.name);
       setDescription(content.description);
       // ... setting other attributes
   };

   server.js The server listens for POST requests to /generate-completion and uses the OpenAI API to generate a game character based on a given context and template, then sends the response to the client.

   app.post('/generate-completion', async (req, res) => {
       // ...
       const chatCompletion = await openai.createChatCompletion({ /*...*/ });
       res.json(chatCompletion.data.choices[0].message);
       // ...
   });

   Explanation: The server listens for POST requests to /generate-completion and uses the OpenAI API to generate a game character based on a given context and template, then sends the response to the client.

4. IPFS Integration:

   We utilize the InterPlanetary File System (IPFS) for decentralized storage.

   const uploadFileToIPFS = async (fileOrUrl) => {
       // ... file upload logic
       const cid = await client.storeBlob(blob);
       return `https://ipfs.io/ipfs/${cid}`;
   };

5. Smart Contract, Unity Integration, AI Interactions, Speech SDK

   To learn more about how we built the entire infrastructure see the code and README in this repository in the /ai-nft-implementation folder

   AINFT Implementation

Usage

1. Selfie to Avatar: Upload your selfie and watch as it gets transformed into an animated avatar.
2. Traits Customization: Personalize your avatar's traits using the sidebar. Choose custom values or click the "Randomize" button for AI-generated traits.
3. Mint to Blockchain: Once satisfied, mint your avatar as an NFT to the Oasys testnet. Ensure your MetaMask is set to the correct network.
4. Interact & Play: Once minted, you can engage with your avatar or use it as a skin in supported games.

🎮 Extended Features and In-Game Integration

This repository goes beyond a simple frontend for minting AINFT avatars. It encompasses a comprehensive ecosystem that enables users to transform selfies into customizable avatars and interact with them through both text and voice.

Game Integration with Unity

Our solution integrates with Unity, allowing users to use their unique avatars as skins in the AILAND shooter game. This personalization adds a fresh and immersive experience for users, giving real value to their NFTs beyond mere collection.

Voice and Text Interactions with AI-Powered Avatars

Leveraging cutting-edge AI technology for a new level of engagement with NFT avatars. Want to communicate with your avatar? With our state-of-the-art AI integrations, you can! Engage in text or voice chats with your avatar, opening up avenues for storytelling, gaming strategies, or simply some light-hearted fun.

Smart Contract Implementations

This repository provides a comprehensive solution with full smart contract implementations tailored for the Oasys. This ensures not just a unique user experience but also a robust and secure transaction environment for minting and transferring the NFTs.

Learn more

To explore the full implementation and delve into the specifics of the AI integration, Unity code, smart contracts, and more, check out the detailed documentation and code here: AINFT Implementation

TomoOne Cat AINFT

Contributing

Contributions are welcome! Please read the CONTRIBUTING.md for guidelines on how to contribute to this project.

License

This project is licensed under the MIT License - see the LICENSE.md file for details.

---