Skip to content

Commit

Permalink
Go handsfree with Copilot with voice dictation (mattermost#7645)
Browse files Browse the repository at this point in the history
  • Loading branch information
cwarnermm authored Dec 9, 2024
1 parent 6ea9300 commit 1241ed9
Showing 1 changed file with 63 additions and 11 deletions.
74 changes: 63 additions & 11 deletions source/collaborate/chat-with-copilot.rst
Original file line number Diff line number Diff line change
Expand Up @@ -20,6 +20,7 @@ With Copilot you can perform the following tasks:
- Stay on top of your messages by identifying next steps, decisions, and unanswered questions
- Extract learnings and transform content into charts, resources, documentation, articles, and more
- Dig further into any topic by asking for insights
- Leverage voice dictation tools for hands-free communication with Copilot

.. note::

Expand Down Expand Up @@ -84,31 +85,36 @@ Summarize threads & unread channel messages
:start-after: :nosearch:

Accelerate decision-making and improve information flows with concise summaries of long discussions delivered to you directly through direct messages.

Ensure you stay on top of communications across threads, channels, and teams, by using Copilot to summarize new messages, identify next steps, and pinpoint unanswered questions.

To summarize Mattermost threads:
.. tab:: Summarize threads

To summarize Mattermost threads:

1. Hover over the first message in any conversation thread, select the **AI Actions** |ai-actions-icon| icon, and select **Summarize Thread**.
2. The thread summary is generated in the Copilot pane, and only you can view the summary.

1. Hover over the first message in any conversation thread, select the **AI Actions** |ai-actions-icon| icon, and select **Summarize Thread**.
2. The thread summary is generated in the Copilot pane, and only you can view the summary.
.. tab:: Summarize unread channels

To summarize unread Mattermost channels:
To summarize unread Mattermost channels:

1. In a channel with unread messages, scroll to the **New Messages** cutoff, select **Ask AI**, and then select **Summarize new messages**.
2. The channel summary is generated in the Copilot pane, and only you can view the summary.
1. In a channel with unread messages, scroll to the **New Messages** cutoff, select **Ask AI**, and then select **Summarize new messages**.
2. The channel summary is generated in the Copilot pane, and only you can view the summary.

When your system admin has :doc:`configured multiple bots </configure/enable-copilot>`, you can switch between them by selecting one from the drop-down menu.
When your system admin has :doc:`configured multiple bots </configure/enable-copilot>`, you can switch between them by selecting one from the drop-down menu.

.. image:: ../images/Unread-Channel-Messages-Summarization-Updated-4-3.gif
:alt: Quickly summarize new messages, find action opens, and seek out unanswered questions with your Copilot.
.. image:: ../images/Unread-Channel-Messages-Summarization-Updated-4-3.gif
:alt: Quickly summarize new messages, find action opens, and seek out unanswered questions with your Copilot.

Bring Copilot into any conversation
------------------------------------

.. include:: ../_static/badges/ent-only.rst
:start-after: :nosearch:

Invoke the power of AI by @mentioning Copilot bots by their username such as ``@copilot`` in any thread to bring AI's capabilities to your conversation, allowing for quick extraction of information or transformation of discussions into charts, resources, documentation, articles, and more. Copilot will find action items and open questions in new messages. With the power of Mattermost integrations and interoperability, the potential to enhance your workflow is limitless.
Invoke the power of AI by @mentioning Copilot bots by their username, such as ``@copilot``, in any thread to bring AI's capabilities to your conversation.

Copilot can help extract information quickly or transform discussions into charts, resources, documentation, articles, and more. Copilot can find action items and open questions in new messages. With the power of Mattermost integrations and interoperability, the potential to enhance your workflow is limitless.

.. image:: ../images/Contextual-Interrogation-Updated-4-3.gif
:alt: Bring your AI into the conversation. @mention your Copilot directly within any thread and use the context to work faster and smarter.
Expand All @@ -117,3 +123,49 @@ Chat privately with Copilot
----------------------------

In addition to chatting with Copilot in the right pane, you can also chat privately with Copilot in direct message threads like you would any other Mattermost user.

Go hands-free with Copilot
~~~~~~~~~~~~~~~~~~~~~~~~~~~

Enable your Operating System's voice dictation or speech recognition tools for hands-free communication with Copilot.

.. tab:: Windows

1. Start a direct message chat with Copilot, and ensure your cursor is in the Mattermost message text box.
2. Ensure your microphone is connected and working.
3. Activate Microsoft Voice Typing by pressing the **Windows** key + :kbd:`H` to open the voice typing tool.
4. Start talking. Windows transforms your voice into text within Mattermost.

See Microsoft's `Voice Typing documentation <https://support.microsoft.com/en-us/windows/use-voice-typing-to-talk-instead-of-type-on-your-pc-fec94565-c4bd-329d-e59a-af033fa5689f>`_ to learn more about working with Microsoft's Voice Typing tools.

.. tab:: MacOS

1. Navigate to **System Settings > Keyboard > Dictation** and enable dictation.

a. Ensure the Microphone source is set correctly.
b. Specify the shortcut key you want to use to turn dictation on and off.

2. Start a direct message chat with Copilot, and ensure your cursor is in the Mattermost message text box.
3. Turn dictation on with the shortcut key you configured, and then start talking. MacOS transforms your voice into text within Mattermost.

See Apple's `Voice control documentation <https://support.apple.com/en-us/102225>`_ to learn more about working with Apple's dictation tools.

.. tab:: Linux

You'll need an open-source speech recognition tool for Linux, such as `Simon <https://simon.kde.org/>`_, `SpeechControl <https://wiki.ubuntu.com/SpeechControl>`_, or `Julius <https://github.com/julius-speech/julius>`_

Once you have a speech recognition tool installed and working, enable it, start a direct message with Copilot, and start talking.

.. tip::

When working with AI technology like Copilot, it's important to understand that the process is often iterative. Using an iterative approach ensures that you leverage Copilot to complement your work, leading to higher quality results. Here are some tips for being more effective with Copilot:

- Avoid a one-and-done mindset: Don't assume that the first output from Copilot will be perfect. Instead, review and refine the content to ensure it meets your standards and needs.

- Make corrections. Use voice dictation to say, "In the second section, remove mention of widgets. Add voice memos instead."
- Make edits. For example, say "Remove Section 3" or "Switch Section 3 with Section 5"
- Reduce unnecessary words. Say, "Remove unnecessary phrases to make this more concise."
- Compact statements. Say, "Condense this into a single paragraph."

- Use AI as a tool, not a replacement: Treat the outputs generated by Copilot as initial drafts. Copilot can help you enhance your writing and analysis, not replace your own skills and judgment. Think of Copilot as your very own high-tech assistant that can provide suggestions and help you brainstorm.
- Iterate for quality: Go through multiple rounds of revisions to catch errors, improve clarity, and refine the content to better align with your goals. By continually reviewing and tweaking the outputs, you'll end up with more polished and accurate content, and maximize the value of Copilot by producing professional-grade results.

0 comments on commit 1241ed9

Please sign in to comment.