Mixed Reality Convenience Store
Tech-Enhanced Learning for Special School Empowerment
Our Vision
To create an inclusive society where all individuals, regardless of their mental or emotional challenges, have the skills and confidence to contribute meaningfully to the workforce and lead fulfilling lives.
Our Mission
To empower mentally and emotionally challenged children through immersive technology-driven vocational training, fostering practical skills, confidence, and social integration.
Future
We aim to expand our program to more schools across Hong Kong and internationally. By standardizing toolkits and creating a customizable platform, we will empower educators globally to tailor training materials to their specific needs, enhancing the reach and impact of our project.
Impact
Since launching, our project has engaged over 100 students, with significant improvements in vocational skills, confidence, and social interaction. Read about how our innovative approach is changing lives and helping students achieve their full potential.
01
Mixed Reality (MR)
Mixed Reality (MR) combines the physical and digital worlds to create immersive learning experiences. In our project, MR is utilized to simulate real-world vocational tasks, such as customer service and product handling, within a controlled, virtual environment. This technology allows students to interact with both digital and physical objects, enhancing their understanding and retention of skills. By engaging in these realistic scenarios, students can practice and refine their abilities in a safe, supportive setting, which is particularly beneficial for mentally and emotionally challenged children.
02
AI Chatbots
Chatbots are intelligent conversational agents integrated into our training modules to provide real-time, interactive feedback and support. Powered by Google's Dialogflow, these chatbots engage students in natural language conversations, simulating real-life interactions such as customer inquiries or peer discussions. This interaction helps develop communication skills, especially for students with Autism Spectrum Disorder (ASD), by offering a non-judgmental, adaptive interface that encourages intuitive communication. Chatbots also help guide students through complex tasks, offering hints and corrections that facilitate a deeper understanding of the material.
03
Computer Vision
Computer Vision is a technology that allows computers to interpret and make decisions based on visual data. In our project, Computer Vision is employed to create interactive VR environments where students can practice recognizing and handling various objects, such as products in a store. This technology supports tasks like product identification and virtual cashier operations, providing instant feedback to help students learn and correct errors in real time. By simulating these real-world tasks, Computer Vision enhances the learning experience, making it more engaging and effective for developing practical vocational skills.