The buzz and excitement about AI is at an all time high. Today few technology and business leaders haven’t heard of OpenAI, ChatGPT, Large Language Models (LLMs) including Llama 2, Bard, and Claude 2, or perhaps the company Hugging Face.
That said, many companies have yet to commit to, and invest in, dedicated research & development into AI and its use in their businesses.
Generative AI Tools (GenAI) is the first step into AI for a majority of companies regardless of industry or country. Why? Simply put, there is no AI research & development (cost and resources) required to get going. GenAI powered tools are accessible as they are being embedded into existing tools that people love and use every day, like Google Workspace.
Digital workplace tools, like Google Workspace and Microsoft 365 are used by 100s of millions of users every day to get work done. Both Google Cloud and Microsoft are ‘AI-enabling’ their existing desktop and mobile messaging and collaboration tools to help companies deliver efficiency and productivity gains.
Duet AI for Google Workspace and Microsoft 365 Copilot are their efforts to bring GenAI to the user, in situ, to help them transform how they work.
We’ve engaged with dozens of companies who are currently evaluating Duet AI for Workspace, and Microsoft 365 Copilot under a Trusted Tester programme. For a majority, five common issues remain;
As a result of these issues, even though the perceived value of these powerful GenAI tools is transformative, and despite millions of users and thousands of companies investing in these evaluations, we are seeing very low conversion rates from Trusted Tester evaluation to a wider rollout.
The reality we hear from customers is that Trusted Tester evaluations do not produce a strong enough business and financial justification for further investment.
Remember these tools are not free, they are additional SKUs that are chargeable under existing agreements and need to demonstrate a demonstrable Return on Investment (ROI).
The way many companies are evaluating Duet AI for Workspace and Microsoft 365 Copilot is unoptimised by design – it lacks the objective data-driven measurement on the impact of these tools on how everyday work gets done. The current approach used by many simply does not stack up to meet the needs for financial sign-off.
We’re pleased to announce the introduction of Temporall’s Impact Assessment for Duet AI for Workspace, and Microsoft 365 Copilot.
The Impact Assessment is a solution that has a number of unique capabilities and deliverables that are designed to help companies evaluate and measure the impact of their evaluations. It is intended to generate objective data-driven insights to support a business case for investing (or not) in Duet AI for Workspace and Microsoft 365 Copilot.
The Impact Assessment can be used by companies who have already started their Trusted Tester programmes – to bring a data-led insights upgrade – and is also there to help businesses evaluate Duet AI for Workspace or Microsoft 365 Copilot for the first time.
Temporall’s digital workplace analytics platform integrates to both Google Workspace and Microsoft 365 (and other digital workplace tools) and provides best of breed analytics for both, we’re well placed to bring you our Impact Assessment.
Temporall’s Impact Assessment is conducted over 45 days and includes the following:
Step 1: Create the Baseline
To understand the impact of the new tools we first need to understand the baseline, a fixed point of reference of how a company uses their digital workplace tools today before GenAI has been introduced.
Step 2: Recommended Participants
Instead of including a random selection of participants, we take a more intentional approach. Using Temporall’s Digital Workplace Analytics platform we identify teams and individuals who are product champions and influencers: they are more active users of digital tools and can provide more robust feedback on tool usage and impact.
Step 3: Comparative Analysis
Using analysis of adoption and usage data from Google Workspace or Microsoft 365 we evaluate the impact of Duet AI or Microsoft 365 Copilot on the workforce.
We compare activity, collaboration and working patterns of the two cohorts: Trusted Testers and non Trusted Testers to provide an analysis of how the adoption of these Gen AI tools has directly impacted activity, utilization, and levels of collaboration/connection.
This analysis is provided at a granular level, sample examples below:
Step 4: Surveys Trusted Tester Participants
In addition to the quantitative comparative analysis in Step 3, the Impact Assessment includes a qualitative approach to bring understanding to how much value Duet AI and Microsoft 365 Copilot brings. Temporall has an in-built survey engine and we have created a custom Impact Assessment Survey specifically for evaluating end-user feedback of using Duet AI or Microsoft 365 Copilot in a Trusted Tester programme.
Our Impact Assessment Survey has been designed by behavioral scientists to elicit the perceived benefits and effect of the tools on their levels of productivity (e.g. speed of work), and efficiency (e.g. task automation/completion), as well as capture free text comments.
Answers to a short survey for Trusted Tester participants are transformed by Temporall into metrics, as well as sentiment and topic analysis of free text answers.
*Please note custom surveys are available at an additional cost.
Step 5: Impact Assessment Report
Our Impact Assessment Report provides a detailed analysis of the tool’s use (e.g. Email, Calendar, Meetings, Content Editing) and working patterns over a 45 day period of Trusted Testers, this is compared to the rest of the organization. It provides a level of detail that will help enablement, training and change management teams know where teams need the most product and adoption support.
It gives quantitative and qualitative data insights on the use of Duet AI for Workspace or Microsoft 365 Copilot, it includes perceived and actual adoption benefits. In the form of an Insights Report our assessment is there to help leaders make a more informed decision about
If and where to invest in Duet AI for Workspace, and Microsoft 365 Copilot.
Sign-up to stay up-to-date on the latest news, insights and conversations around the digital workplace.
Book a 30 minute Demo
Learn how Temporall unifies and analyses your digital workplace data to give you actionable intelligence.
Book a 30 minute Demo
Google Workspace is where work happens.
Realise its full transformative and economic power with actionable insights.