We had the distinct pleasure to interview award winning designer Jiayi Chen about their original and creative Mixed Reality Interface design work. Jiayi Chen is an award-winning communication designer, that makes our world a better place with their original mixed reality interface works.
Jiayi Chen ("JC") answered Design Interview ("DI") questions about their award-winning work Mukden Palace Experience Mixed Reality Interface. Interview questions prepared by Frank Scott.
JC : In designing the Mukden Palace Experience, we deeply understood the importance of preserving traditional museums and ancient architecture. Therefore, we emphasized respecting and safeguarding the authenticity of cultural relics in our digital interactive experience. In addition to providing more detailed information about artifacts, we also focused on providing detailed interpretations of calligraphy and paintings, allowing visitors to gain a deeper understanding of the cultural significance behind history. For artifacts such as ceramics, armor, and jade, we utilized 3D technology to enable visitors to experience these precious relics in a more immersive way. Through these designs, our goal is to respect and carry forward the essence of history while providing visitors with a unique and enriching cultural journey.
JC : In designing the Mukden Palace Experience, my main focus was to strike a delicate balance between innovation and tradition. I wanted to achieve a design that seamlessly integrated modern technology, specifically Apple Vision Pro, with the rich cultural heritage of the Shenyang Palace Museum. By leveraging mixed reality technology, I aimed to provide visitors with an immersive and interactive exploration of the museum's exhibits, while also preserving the authenticity and historical significance of the artifacts. Additionally, as the first A' Design Award-winning project based on Apple Vision Pro, I was driven by a desire to showcase the project's innovative nature and its potential to inspire future generations of designers. I wanted to demonstrate the possibilities of utilizing emerging technologies in the field of user experience design, particularly in the context of cultural heritage sites. By pushing the boundaries of traditional museum experiences, I hoped to encourage other designers to explore the endless opportunities presented by spatial computing and mixed reality interfaces. In essence, my main focus in designing the Mukden Palace Experience was to create a truly immersive and educational experience for museum visitors, while also pushing the boundaries of design innovation in the digital age.
JC : Moving forward, my plans for the award-winning Mukden Palace Experience involve further refinement and expansion, with the ultimate goal of establishing it as a prominent application on the market for Apple Vision Pro users. I aim to continue collaborating with stakeholders, including museum curators, technologists, and user experience experts, to enhance the functionality and usability of the application. Additionally, I plan to explore opportunities for partnerships and collaborations with other cultural heritage institutions to adapt the Mukden Palace Experience for use in different contexts and settings. By leveraging the flexibility and scalability of mixed reality technology, I envision the potential for this design to be applied to various historical sites and museums around the world, providing visitors with immersive and educational experiences wherever they go. Furthermore, I am committed to staying updated on the latest advancements in spatial computing and mixed reality interfaces, and integrating new features and functionalities into the Mukden Palace Experience to ensure its relevance and effectiveness in the ever-evolving landscape of digital design. Overall, my future plans for this award-winning design revolve around continuous improvement, innovation, and expansion, with the aim of making it a benchmark application in the field of cultural heritage and mixed reality experiences.
JC : It took approximately one month for initial research and ideation, followed by two months of design iteration and usability testing. In total, the concept was developed over a period of about three months. This timeline allowed for thorough exploration of user needs, iterative design refinement, and comprehensive testing to ensure the effectiveness and usability of the final product.
JC : This design was not commissioned; rather, it stemmed from a personal aspiration to innovate and explore the potential of mixed reality in cultural heritage sites. Inspired by the need to bridge the gap between traditional museum experiences and modern interactive technologies, I embarked on this project with a vision to create a more immersive and engaging way for visitors to connect with historical artifacts. By leveraging mixed reality and incorporating user-centered design principles, I aimed to provide an enriching experience that would resonate with both casual visitors and history enthusiasts alike.
JC : Certainly, I do maintain an open stance regarding the potential production or utilization of my design. While there are currently no definitive plans in place for its commercialization, I am open to exploring opportunities for collaboration or partnerships with companies interested in bringing this concept to fruition. Whether through licensing the production rights, co-developing with a manufacturing partner, or even self-production, I am flexible and eager to see this design contribute to enhancing cultural experiences for a broader audience.
JC : The inspiration behind designing this particular type of work stemmed from a desire to address a significant gap in the realm of cultural heritage experiences. Traditional museums often struggle to provide engaging and immersive interactions with historical artifacts, especially within the confines of ancient structures like palaces. Recognizing this challenge, I was motivated to leverage cutting-edge technology, such as mixed reality, to create a solution that would bridge the gap between traditional museum exhibits and modern digital experiences. Moreover, my personal passion for preserving cultural heritage and making it accessible to a broader audience also fueled the design process. I wanted to create an innovative solution that not only enhances the visitor experience but also preserves the authenticity and historical significance of cultural landmarks like the Mukden Palace. By combining technology with a deep appreciation for history and culture, I aimed to design an experience that resonates with both contemporary audiences and heritage enthusiasts alike.
JC : The design of my work was significantly influenced by the introduction of new technologies, particularly the Apple Vision Pro. This innovative technology provided a foundation for creating immersive mixed reality experiences that seamlessly integrate digital content with real-world environments. Drawing inspiration from the capabilities of Apple Vision Pro, I envisioned a design that leverages eye-tracking and gesture controls to enhance the exploration of cultural heritage sites like the Mukden Palace. Additionally, while I drew inspiration from various sources within the design community, including other designers and their works, the primary driving force behind the design was the potential of emerging technologies to transform the way we interact with historical artifacts and cultural landmarks. By embracing advancements like Apple Vision Pro, I sought to push the boundaries of traditional museum experiences and pave the way for more engaging and immersive interactions in the future.
JC : The target customers for this design are visitors to cultural heritage sites, particularly those who visit the Mukden Palace Museum. The design aims to cater to a diverse audience, including history enthusiasts, tourists, families, and children. By providing an immersive and interactive experience, the design seeks to engage visitors of all ages and backgrounds, sparking their curiosity and enhancing their understanding of the historical artifacts and cultural significance of the site. Specifically, the design is tailored to appeal to individuals interested in history, art, and cultural heritage, with a focus on making the museum experience more enjoyable and educational for children and families.
JC : This design stands out from other similar concepts due to its innovative use of mixed reality technology to enhance the museum experience. While there may be other digital interactive experiences in cultural heritage sites, the Mukden Palace Experience distinguishes itself by offering a truly immersive and engaging exploration of historical exhibits. One key aspect that sets this design apart is its emphasis on preserving the authenticity of cultural artifacts while providing a modern and interactive experience. By incorporating mixed reality technology, the design allows visitors to delve deeper into the exhibits, providing detailed descriptions, 3D visualizations, and interactive elements that enrich their understanding of the historical significance of each artifact. Additionally, the design's focus on user experience and accessibility sets it apart from other similar concepts. By utilizing eye-tracking and gesture controls, the experience is intuitive and user-friendly, allowing visitors of all ages and backgrounds to interact with the exhibits seamlessly. Overall, the Mukden Palace Experience stands out for its combination of cutting-edge technology, preservation of cultural heritage, and emphasis on user engagement, making it a unique and memorable experience for museum visitors.
JC : The name "Mukden Palace Experience" was inspired by the location of the project and the immersive nature of the design. "Mukden Palace" refers to the historical site where the project is based, which is also known as the Shenyang Imperial Palace or Shenyang Gugong. This palace served as the residence of the early Qing dynasty emperors and is now a UNESCO World Heritage Site. The term "Experience" was chosen to convey the immersive and interactive nature of the design. By using mixed reality technology, the project aims to provide visitors with a unique and memorable experience of exploring the palace and its exhibits. The word "Experience" also signifies the emphasis on user engagement and participation, inviting visitors to actively interact with the cultural artifacts and historical content presented in the museum. Overall, the name "Mukden Palace Experience" encapsulates the essence of the project, which is to offer visitors an immersive and enriching experience of the historical site and its treasures through innovative digital interaction.
JC : Figma and Adobe Photoshop were the primary design tools used for this project. Figma is a collaborative interface design tool that allows for the creation of interactive prototypes and user interface designs. It was used for wireframing, creating interface mockups, and designing the overall user experience. Adobe Photoshop, on the other hand, is a versatile graphic design software widely used for image editing and digital art creation. In this project, Photoshop was utilized for tasks such as image manipulation, creating visual assets, and refining the visual aesthetics of the interface elements. These tools were chosen for their flexibility, efficiency, and compatibility with the project's requirements. By leveraging the capabilities of Figma and Photoshop, we were able to streamline the design process and create high-quality visual assets that contributed to the overall success of the project.
JC : The most unique aspect of the "Mukden Palace Experience" design is its utilization of mixed reality technology to enhance the exploration of cultural heritage sites. Unlike traditional museum experiences that rely solely on physical exhibits and textual descriptions, this design offers visitors an immersive journey through history using cutting-edge technology. By leveraging devices like the Apple Vision Pro and an interactive application, users can engage with exhibits in a more interactive and dynamic manner. They can delve deeper into the historical significance of artifacts, explore detailed descriptions, and even experience 3D renderings of items like ceramics, armor, and jade artifacts. This blending of physical artifacts with digital interaction creates a truly unique and immersive experience, bridging the gap between the past and the present. It allows visitors to engage with history in a more tangible and memorable way, fostering a deeper appreciation for cultural heritage and historical significance.
JC : For the "Mukden Palace Experience" design, I primarily collaborated with myself, taking on multiple roles throughout the project. As the sole designer, I was responsible for conceptualizing, designing, and implementing the mixed reality interface. While I didn't collaborate with individuals possessing technical or specialized skills directly, I did rely on resources and documentation provided by companies like Apple for their Vision Pro technology. Additionally, I stayed informed about the latest developments in mixed reality and user experience design to ensure the project's success. By taking on various roles and staying updated on relevant technologies, I was able to create a comprehensive design that effectively utilized mixed reality to enhance the museum experience at the Mukden Palace.
JC : Technology plays a central role in the "Mukden Palace Experience" design, particularly through the implementation of mixed reality technology, specifically Apple's Vision Pro platform. This technology allows visitors to immerse themselves in a digital interactive experience while exploring the exhibits at the Mukden Palace Museum. The use of mixed reality technology enhances the traditional museum experience by providing visitors with additional layers of information, interactivity, and engagement. Through eye-tracking and gesture controls, users can interact with the exhibits in a more intuitive and immersive manner, gaining deeper insights into the cultural significance and historical context of the artifacts on display. By leveraging technology, this design not only preserves the authenticity of the cultural heritage site but also enhances the visitor experience, making it more engaging, informative, and memorable.
JC : The design of the "Mukden Palace Experience" was indeed influenced by extensive data and analytical research. To ensure the effectiveness and relevance of the design, I conducted field research at the Shenyang Palace Museum in Shenyang, Liaoning Province, China. This involved observing how visitors interacted with historical exhibits and identifying any challenges or limitations in their exploration methods. Through this field research, I discovered that many visitors relied on traditional audio guide devices, which provided fixed explanations activated by entering corresponding numbers. However, this approach lacked novelty and interactivity, particularly for repeat visitors. Additionally, visitors often faced difficulties in obtaining detailed information or clarifications about specific exhibit details in the absence of experts on-site. Furthermore, I conducted ethnographic research to understand the diverse demographics of visitors to the museum and their expectations. This research revealed a significant interest among visitors in experiencing the integration of heritage sites with technology, indicating a desire for innovative and immersive experiences. Based on these insights, the design of the "Mukden Palace Experience" aimed to address these challenges and cater to the evolving needs and expectations of visitors. By leveraging mixed reality technology and intuitive interaction methods, the design seeks to enhance the visitor experience, providing them with deeper insights, interactivity, and engagement while exploring the cultural heritage site.
JC : Some of the challenges I encountered during the design and realization of the "Mukden Palace Experience" concept included: Technical Understanding: Given the innovative nature of the project, one of the primary challenges was gaining a comprehensive understanding of the capabilities and technical specifications of the Apple Vision Pro device. This involved delving into the intricacies of the hardware and software components, as well as understanding its limitations and potential for integration with mixed reality experiences. Parameter Optimization: Ensuring optimal performance and user experience required meticulous parameter optimization, particularly concerning eye-tracking accuracy and gesture interaction. Fine-tuning these parameters was crucial to achieving seamless interaction and minimizing user frustration. User Interface Design: Designing an intuitive and user-friendly interface for the mixed reality application posed its own set of challenges. Balancing aesthetic appeal with functional usability, while adhering to Apple Vision Pro's design guidelines, required careful consideration of layout, typography, and interactive elements. Content Integration: Incorporating detailed descriptions, historical analysis, multimedia assets, and 3D experiences for the exhibits presented logistical challenges in terms of content integration and synchronization. Ensuring that the content seamlessly aligned with the user's exploration journey while maintaining coherence and relevance was a complex task. Testing and Validation: Conducting thorough testing and validation of the mixed reality experience across various devices and user scenarios was essential to identify and address any usability issues or technical glitches. This iterative process required time and resources to refine the design based on user feedback and performance metrics. Overall, overcoming these challenges involved a combination of technical expertise, creative problem-solving, and iterative design refinement to deliver a compelling and immersive experience for visitors to the Shenyang Palace Museum.
JC : Submitting my design to an international design competition like A' Design was a decision influenced by several factors. Firstly, I admired the international prestige and recognition associated with the A' Design Awards. I saw it as an opportunity to showcase my design skills on a global platform and gain validation for my work from esteemed professionals in the field. Moreover, participating in such competitions provides valuable exposure and networking opportunities, allowing me to connect with fellow designers, industry experts, and potential collaborators from around the world. It also offers a chance to benchmark my work against other outstanding designs and learn from their innovative approaches and best practices. Ultimately, my decision to submit to A' Design was driven by a desire to seek recognition for my design achievements, elevate my professional profile, and contribute to the global design community by sharing my unique perspectives and insights.
JC : During the design process of this work, I learned several valuable lessons and experienced significant personal growth. Firstly, I deepened my understanding of mixed reality technologies, particularly Apple Vision Pro, and gained proficiency in incorporating them into interactive design solutions. This project provided me with hands-on experience in utilizing eye-tracking and gesture recognition functionalities to enhance user experiences. Additionally, I honed my skills in user research and empathy-driven design. Through field observations, surveys, and interviews, I gained insights into the diverse needs and preferences of museum visitors, which informed the development of user personas and journey maps. This enabled me to tailor the design to meet the specific needs of different user groups and create a more inclusive and engaging experience for all. Furthermore, the collaborative nature of this project allowed me to enhance my communication and teamwork skills. Working closely with stakeholders, developers, and other design professionals, I learned to effectively communicate my ideas, solicit feedback, and iterate on designs based on user insights and stakeholder input. Overall, the designing of this work was a transformative learning experience that not only expanded my technical skills but also deepened my appreciation for the role of design in creating meaningful and impactful experiences for users.
