Breaking News
light_mode
Trending Tags
Beranda » Internasional » The Future of Mixed Reality: Blending the Virtual and the Real

The Future of Mixed Reality: Blending the Virtual and the Real

  • account_circle Lili Cheng
  • calendar_month Selasa, 28 Jan 2025
  • visibility 1.071
  • comment 0 komentar

At Microsoft Ignite 2023, we are announcing Copilot in Microsoft Dynamics 365 Guides, which combines the power of generative AI with mixed reality to help frontline workers complete complex tasks and resolve issues faster with less disruption to the flow of work.

Copilot in Dynamics 365 Guides assists workers in industrial settings who deal with complex equipment and processes. New technicians need to ramp up quickly while learning how to operate and service that equipment. When equipment stops functioning, workers must act quickly to diagnose the problem, implement a fix, and then document their work. Instead of workers needing to search through volumes of digital documents or paper manuals, Copilot enables workers to ask for relevant information using natural language and human gestures, such as looking and pointing. Copilot uses generative AI to search for information from technical documentation, service records, training content, and any other data sources that customers curate. Copilot then summarizes the information to provide interactive guidance through content and holograms overlaid on the equipment in operation or maintenance.

Mixed reality together with AI presents a human-first interface that promises to transform real-world operations. Now, Copilot can assist industrial workers in real-time with speech and holograms.

Copilot in Dynamics 365 Guides capabilities

Here are the capabilities we plan to unlock with Copilot in Dynamics 365 Guides:

Point and Ask Guidance

Humans have always learned from and interacted with their environment in a hands-on manner, asking questions of others as they work. Copilot in Dynamics 365 Guides builds on that natural way of interacting to help workers better understand the world around them. Workers can point to a component on an asset and ask Copilot questions, such as “What is the torque limit for these bolts?” New workers can ask general questions, such as “What is the function of this component?” without needing to interrupt a more experienced coworker. Copilot recognizes what the user is pointing at and provides answers. 3D models and spatial maps provide the foundation for the technology to identify what the worker is looking at and then project a hologram to show instructions. Workers can ask more complex questions, such as “Which direction does this part fit?” or “Show me where the sensor module is on this machine,” and Copilot will display holograms to show where the part belongs.

Spatial Content Generation

Copilot in Dynamics 365 Guides accelerates the out-of-the-box value of mixed reality by significantly reducing the upfront investment needed to create spatial content. Copilot simplifies the creation, management, and delivery of mixed reality content using customer-defined data sources, enabling companies to adopt mixed reality much faster.

Step-by-Step Assistance

Powered by Microsoft Azure OpenAI Service, large language models allow Copilot in Dynamics 365 Guides to do far more than answer one-off questions. Workers can have progressive conversations, such as “Walk me through the steps to disassemble this filtration unit,” or “I disconnected the motor, what’s next?” Copilot follows along with the process and conversation using customer’s curated knowledge base to articulate answers with speech, text, or 3D holograms, eliminating ambiguity and reducing the need for rework.

Rekomendasi Untuk Anda

  • Gudang di Larangan Tangerang Terbakar, Asap Hitam Tebal Mengepul Tinggi

    Gudang di Larangan Tangerang Terbakar, Asap Hitam Tebal Mengepul Tinggi

    • calendar_month Selasa, 29 Apr 2025
    • account_circle bantenpost.net
    • visibility 90
    • 0Komentar

    Kota Tangerang – Kebakaran terjadi di Kecamatan Larang, Kota Tangerang, Banten. Petugas pemadam kebakaran (damkar) menerima informasi awal bahwa yang terbakar adalah bangunan gudang. “Betul ada kebakaran, informasi awal yang kami terima, yang terbakar gudang plastik,” kata petugas Command Center Dinas Damkar Kota Tangerang, Dadang, saat dihubungi, Senin (14/4/2025). Petugas damkar menerima informasi terjadinya kebakaran […]

  • Akademisi Minta Program Makan Bergizi Gratis di Banten Dievaluasi

    Akademisi Minta Program Makan Bergizi Gratis di Banten Dievaluasi

    • calendar_month Selasa, 29 Apr 2025
    • account_circle bantenpost.net
    • visibility 169
    • 0Komentar

    Pengamat Kebijakan Publik Banten, Ahmad Sururi, meminta agar program Makan Bergizi Gratis (MBG) yang dijalankan di Provinsi Banten dievaluasi secara menyeluruh. Menurutnya, meskipun program ini bertujuan baik untuk meningkatkan gizi masyarakat, pelaksanaannya perlu dikaji agar tepat sasaran dan efektif. Ahmad Sururi menyoroti beberapa kendala yang terjadi dalam pelaksanaan program tersebut, seperti distribusi makanan yang belum […]

  • Budi Gunawan Soal Karhutla: Kita Harus Belajar dari AS, Jepang, dan Korsel

    Budi Gunawan Soal Karhutla: Kita Harus Belajar dari AS, Jepang, dan Korsel

    • calendar_month Selasa, 29 Apr 2025
    • account_circle bantenpost.net
    • visibility 220
    • 0Komentar

    JAKARTA, KOMPAS.com – Menteri Koordinator Bidang Politik dan Keamanan (Menko Polkam) Budi Gunawan menyebutkan Indonesia harus belajar dari pengalaman Amerika Serikat (AS), Jepang, dan Korea Selatan soal dampak dari kebakaran hutan dan lahan (karhutla). “Kita harus belajar dari pengalaman negara lain, di Amerika Serikat, Jepang, dan Korea Selatan, bahwa akibat perubahan iklim, dampak kebakaran hutan […]

  • Dr. Simon Ex Bupati Malaka: Hapus KASN Sama Saja Membuka Pintu Intervensi Politik ke Birokrasi!

    Dr. Simon Ex Bupati Malaka: Hapus KASN Sama Saja Membuka Pintu Intervensi Politik ke Birokrasi!

    • calendar_month Minggu, 25 Mei 2025
    • account_circle bantenpost.net
    • visibility 66
    • 0Komentar

    Jakarta,24 Jakarta-Mantan Bupati Malaka Dr. Simon Nahak menyampaikan sikap tegas menolak pembubaran Komisi Aparatur Sipil Negara (KASN) yang saat ini sedang digugat di Mahkamah Konstitusi oleh sejumlah LSM. Menurutnya, KASN bukan hanya lembaga administratif biasa, tapi penjaga utama integritas birokrasi Indonesia. “Saya tidak sependapat dengan pembubaran KASN. Justru saat ini kehadirannya makin penting untuk memastikan […]

  • Sunyinya Proyek Jalan Senilai Rp70 M di Mempawah, KPK Diingatkan Jangan Bermain Ikan Kecil

    Sunyinya Proyek Jalan Senilai Rp70 M di Mempawah, KPK Diingatkan Jangan Bermain Ikan Kecil

    • calendar_month Kamis, 22 Mei 2025
    • account_circle bantenpost.net
    • visibility 62
    • 0Komentar

    Pontianak- Dua perusahaan pemenang tender proyek peningkatan ruas jalan di Kabupaten Mempawah, Kalimantan Barat senilai Rp70 miliar perlu diaudit dan tidak transparan. Proyek ini dialokasikan Dinas Pekerjaan Umum (PU) Kabupaten Mempawah di tahun 2015. Berdasarkan situs AHU, kedua perusahaan ini belum melaporkan siapa pemilik manfaatnya. Kedua perusahaan yang memenangkan proyek peningkatan dua ruas jalan di Kabupaten […]

  • Polemik Perjalanan Dinas Pemprov DKI dan Rindu Kota Paris

    Polemik Perjalanan Dinas Pemprov DKI dan Rindu Kota Paris

    • calendar_month Kamis, 22 Mei 2025
    • account_circle bantenpost.net
    • visibility 73
    • 0Komentar

    JAKARTA-Polemik Perjalanan Dinas Pemprov DKI dan Rindu di Kota Cinta atau Paris yang merupakan ibu kota dari negara Prancis telah menjadi sorotan di kota Betawi. Pasalnya, ada seorang istri dari Kepala dari Kepala Dinas Pariwisata DKI, Andhika Permata yang berangkat menuju pusat mode dunia itu sebagai delegasi tambahan dengan biaya yang dibebankan ke APBD DPA […]

expand_less