GEND.AR

2024

byBotao Amber Hu, Yilan Tao, Yuxin Hao

Privacy-Preserving Gender-Inclusive In-Person Social Encounters Using Secure Multiparty Computation in Extended Reality

Abstract

Spontaneous social encounters in contemporary society present a coordination challenge around gender and identity. While some people rely on visual cues and stereotypes (colloquially known as 'gaydar') to infer others' gender identity, expression, orientation, or preferred pronouns, such assumptions are both unreliable and potentially harmful. This creates a social dilemma: direct questions about personal identity may feel invasive, yet incorrect assumptions can damage relationships and cause distress. The challenge lies in navigating these interactions respectfully while acknowledging both individual privacy and the need for authentic recognition.

We propose GEND.AR, an extended reality application that addresses this social coordination challenge through privacy-preserving technology. The system enables users to discover compatible individuals within their social proximity (10-20 meters) without compromising personal information. Using secure two-party computation protocols over Apple's MultipeerConnectivity framework (technology behind AirDrop), GEND.AR performs encrypted compatibility calculations when users are nearby. These calculations consider sexual orientation, gender identity, availability, and visibility preferences, without revealing individual attributes to anyone—including non-matching users and third parties. All personal information remains exclusively on users' devices, eliminating the need for centralized servers.

Upon detecting a mutual match, the extended reality interface displays a subtle, calming animated visual indicator connecting the matched users. This minimalist approach avoids intrusive notifications while maintaining discretion. Non-matching users receive no notifications, thereby preserving privacy and preventing social awkwardness. To ensure authenticity and prevent misuse, the system employs zero-knowledge proof technology through platforms like OpenPassport and WorldCoin, requiring proof of personhood through bio-verification or passport-proof identities. While the system supports gender fluidity, it maintains accountability by tracking identity changes—users' identity modification patterns are visible to potential matches, and frequent changes are flagged to prevent potential misuse of the platform.

As an experiential futures design, GEND.AR explores potential technological solutions for facilitating authentic social connections in gender-inclusive spaces. While current technological and social constraints may limit immediate widespread adoption, this speculative project aims to spark discussion about how privacy-preserving technology could support authentic social connections while maintaining individual dignity and agency in future gender-inclusive spaces.

Slogan

Envision a Flourishing Future of Privacy-Preserving Gender-Inclusive Social Encounters

Venue

Edge City Lanna Hachathon with GEND.AR BUILD

Technological Stack

  • Game Engine:

  • Hardware:

    • HoloKit MR headset for spatial computing
    • iPhone 15 Pro for computational processing
  • Network Layer: Apple's MultipeerConnectivity

  • Identity Verification (Zero-Knowledge Proof):

  • Core Protocol:

    • We employed a secure two-party computation (2PC) Cursive Team's 2P-PSI that:
      • Enables private set interaction between users Maintains privacy of user preferences
      • Operates in real-time within spatial computing constraints

Implementations

GEND.AR has been prototyped as a proof-of-concept mixed reality application combining privacy-preserving computation with spatial computing. Built on Unity 6 LTS and targeting the HoloKit mixed reality headset paired with iPhone 15 Pro, our implementation leverages HoloKit's optical system for immersive experiences and the iPhone's Neural Engine for high-performance processing. The core functionality centers on a secure two-party computation protocol operating over Apple's MultipeerConnectivity framework, enabling private set intersection between users while maintaining preference confidentiality. Currently in the testing phase, our team is focused on fine-tuning the user experience, optimizing computational performance, reducing power consumption, minimizing interaction latency, and validating protocol security to advance privacy-conscious mixed reality social interactions.

Inspiration

This work draws inspiration from Barry Whitehat's influential presentation "2PC is for Lovers" delivered at PROGCRYPTO 2023.

Acknowledgements

Thanks to Vivek and Andrew from Cursive Team for their support on 2PC.



cover 3.

_resources/GEND.AR/1b6c19e940ba3dac05fe790e4b2d33ee_MD5.

Metadata

Media: Headworn AR

Technologies: End-to-end encryption, Decentralized matching, Biometric verification

Research Topics: Protocol, Embodied Interaction in Mixed Reality

Credits

Director: Botao Amber Hu

Concept Designer: Botao Amber Hu

Concept Designer: Yuxin Hao

User Experience Designer: Yuxin Hao

User Experience Designer: Yilan Tao