www.atlassian.com Open in urlscan Pro
185.166.143.31  Public Scan

Submitted URL: https://click.e.atlassian.com/?qs=429337218cf90c1b091e7d672e1e177b029a3894638abbc3cda7f0eb8837c5fa76219e4451cef6296a527830d4c8...
Effective URL: https://www.atlassian.com/agile/product-management/product-analytics?utm_source=newsletter-email&utm_medium=email&utm_camp...
Submission: On October 19 via api from SG — Scanned from DE

Form analysis 4 forms found in the DOM

GET /search

<form class="global-nav--wac__search-form" action="/search" method="GET">
  <div class="global-nav--wac__search-container">
    <div class="global-nav--wac__search-input-container"> <label for="global-nav-wac-search">Search atlassian.com</label> <input id="global-nav-wac-search" name="q" class="global-nav--wac__search-input" type="text" autocomplete="off"
        placeholder="Search"> </div> <input type="submit" class="global-nav--wac__search-submit" value="Search" data-event="clicked" data-uuid="98b3366a-bb-submit" data-event-component="linkButton" data-event-container="globalNavWac"
      data-schema-version="1" data-product-key="jiraSoftware">
    <a href="#" class="global-nav--wac__search-close" data-event="clicked" data-uuid="98b3366a-bb-close" data-event-component="linkButton" data-event-container="globalNavWac" data-schema-version="1" data-product-key="jiraSoftware">Close search</a>
  </div>
</form>

<form class="exact-target-form" data-mailing-list-id="1239131" novalidate="novalidate">
  <div class="exact-target-form__label"> <label for="et-4b1d6be5-85b4-401a-b05b-c61be1b08f6c">Email</label> </div>
  <div class="exact-target-form__email-input"> <input type="email" name="et-4b1d6be5-85b4-401a-b05b-c61be1b08f6c" required="" id="et-4b1d6be5-85b4-401a-b05b-c61be1b08f6c" placeholder="email@example.com"> </div>
  <div class="exact-target-form__hp-field"> <input type="text" name="list_name" aria-label="Keep this field blank"> </div>
  <div class="exact-target-form__submit-input"> <input type="submit" data-event="clicked" data-uuid="4b1d6be5-85" data-event-component="linkButton" data-event-container="exactTargetForm" data-schema-version="1" data-product-key="jiraSoftware"
      value="Subscribe" class="button button--one button--regular button--secondary"> </div>
</form>

<form class="exact-target-form" data-mailing-list-id="1239131" novalidate="novalidate">
  <div class="exact-target-form__label"> <label for="et-10c5c932-68d7-4db6-b1d1-959f4255d218">Email</label> </div>
  <div class="exact-target-form__email-input"> <input type="email" name="et-10c5c932-68d7-4db6-b1d1-959f4255d218" required="" id="et-10c5c932-68d7-4db6-b1d1-959f4255d218" placeholder="email@example.com"> </div>
  <div class="exact-target-form__hp-field"> <input type="text" name="list_name" aria-label="Keep this field blank"> </div>
  <div class="exact-target-form__submit-input"> <input type="submit" data-event="clicked" data-uuid="10c5c932-68" data-event-component="linkButton" data-event-container="exactTargetForm" data-schema-version="1" data-product-key="jiraSoftware"
      value="Subscribe" class="button button--one button--regular button--secondary"> </div>
</form>

GET #

<form action="#" method="GET"> <label for="footer-language-selector" aria-label="Choose your language"></label> <select id="footer-language-selector" option="language-selector" name="url">
    <option disabled="">Choose your language</option>
    <option aria-label="Deutsch" class="notranslate SL_opaque" data-lang="de" value="https://www.atlassian.com/de/agile/product-management/product-analytics">Deutsch</option>
    <option selected="" aria-label="English" class="notranslate SL_opaque" data-lang="en" value="https://www.atlassian.com/agile/product-management/product-analytics">English</option>
    <option aria-label="Español" class="notranslate SL_opaque" data-lang="es" value="https://www.atlassian.com/es/agile/product-management/product-analytics">Español</option>
    <option aria-label="Français" class="notranslate SL_opaque" data-lang="fr" value="https://www.atlassian.com/fr/agile/product-management/product-analytics">Français</option>
    <option aria-label="Italiano" class="notranslate SL_opaque" data-lang="it" value="https://www.atlassian.com/it/agile/product-management/product-analytics">Italiano</option>
    <option aria-label="한국어" class="notranslate SL_opaque" data-lang="ko" value="https://www.atlassian.com/ko/agile/product-management/product-analytics">한국어</option>
    <option aria-label="Magyar" class="notranslate SL_opaque" data-lang="hu" value="https://www.atlassian.com/hu/agile/product-management/product-analytics">Magyar</option>
    <option aria-label="Nederlands" class="notranslate SL_opaque" data-lang="nl" value="https://www.atlassian.com/nl/agile/product-management/product-analytics">Nederlands</option>
    <option aria-label="日本語" class="notranslate SL_opaque" data-lang="ja" value="https://www.atlassian.com/ja/agile/product-management/product-analytics">日本語</option>
    <option aria-label="Polski" class="notranslate SL_opaque" data-lang="pl" value="https://www.atlassian.com/pl/agile/product-management/product-analytics">Polski</option>
    <option aria-label="Português" class="notranslate SL_opaque" data-lang="br" value="https://www.atlassian.com/br/agile/product-management/product-analytics">Português</option>
    <option aria-label="русский" class="notranslate SL_opaque" data-lang="ru" value="https://www.atlassian.com/ru/agile/product-management/product-analytics">русский</option>
    <option aria-label="中文" class="notranslate SL_opaque" data-lang="zh" value="https://www.atlassian.com/zh/agile/product-management/product-analytics">中文</option>
  </select>
  <script type="text/x-component"> { "type":"imkt.components.LanguageSelector", "params": { } } </script>
</form>

Text Content

Back
Products
For teams
Support
 * Support

 * View all products
 * Atlassian.com

Try now
Buy now
Search Toggle menu



My account


Search atlassian.com
Close search


FEATURED


JIRA SOFTWARE

Project and issue tracking


CONFLUENCE

Content collaboration


JIRA SERVICE MANAGEMENT

High-velocity ITSM


TRELLO

Visual project management

View all products


NEW PRODUCTS FROM POINT A

Innovations from Atlassian

View all


ATLAS

Teamwork directory


COMPASS

Developer experience platform




MARKETPLACE

Connect thousands of apps for all your Atlassian products




 * BROWSE BY SOLUTION
   
   
   AGILE & DEVOPS
   
   Run a world-class agile software organization from discovery to delivery and
   operations
   
   
   IT SERVICE MANAGEMENT
   
   Enable dev, IT ops, and business teams to deliver great service at high
   velocity
   
   
   WORK MANAGEMENT
   
   Empower autonomous teams without losing organizational alignment


 * BROWSE BY TEAM TYPE
   
   
   ENTERPRISE
   
   
   
   
   SMALL BUSINESS
   
   
   
   
   STARTUP
   
   
   
   
   NON-PROFIT
   
   

Close dropdown


BY TEAM SIZE


STARTUPS

Great for startups, from incubator to IPO


SMALL BUSINESS

Get the right tools for your growing business


ENTERPRISE

Learn how we make big teams successful


BY TEAM FUNCTION


SOFTWARE

Plan, build, & ship quality products


MARKETING

Bring together a winning strategy


HR

Streamline people management


LEGAL

Operate securely and reliably


OPERATIONS

Run your business efficiently


IT

Provide great service and support


FINANCE

Simplify all finance processes


INCIDENT RESPONSE

Respond, resolve, & learn from incidents

View all products



 * MARKETPLACE
   
   Apps that enhance Atlassian products


 * DEVELOPERS
   
   Docs and resources to build Atlassian apps


 * TRUST & SECURITY
   
   Compliance, privacy, platform roadmap, and more


 * WORK LIFE BLOG
   
   Stories on culture, tech, teams, and tips

Close dropdown


RESOURCES


DOCUMENTATION

Guides to all of our products


ATLASSIAN MIGRATION PROGRAM

Tools and guidance for migrating


CLOUD ROADMAP

Upcoming feature releases


PURCHASING & LICENSING

FAQs about our policies


SUPPORT SERVICES


ENTERPRISE SERVICES

Personal support for large teams


PARTNER SUPPORT

Trusted third-party consultants


ATLASSIAN SUPPORT

A resource hub for teams and admins


LEARN & CONNECT


ABOUT US

Our mission and history


CAREERS

Job openings, values, and more


ATLASSIAN UNIVERSITY

Training and certifications for all skill levels


ATLASSIAN COMMUNITY

A forum for connecting, sharing, and learning




 * MARKETPLACE
   
   Apps that enhance Atlassian products


 * DEVELOPERS
   
   Docs and resources to build Atlassian apps


 * TRUST & SECURITY
   
   Compliance, privacy, platform roadmap, and more


 * WORK LIFE BLOG
   
   Stories on culture, tech, teams, and tips

Close dropdown
 * Agile
 * Product Management
 * Product analytics


WHAT EVERY PRODUCT MANAGER NEEDS TO KNOW ABOUT PRODUCT ANALYTICS

The data we glean from product analytics tells us how users actually use the
product.

By Sam Tardif

BROWSE TOPICS

Agile manifesto

Scrum

Back
Overview
Sprints
Sprint planning
Ceremonies
Backlogs
Sprint reviews
Standups
Scrum master
Retrospectives
Distributed scrum
Roles
Scrum of scrums
Agile scrum artifacts
Scrum metrics
Jira Confluence scrum

Kanban

Back
Overview
Boards
WIP limits
Kanban vs Scrum
Kanplan
Kanban cards

Agile project management

Back
Overview
Project management intro
Workflow
Epics, stories, themes
Epics
User Stories
Estimation
Metrics
Gantt chart
Program management vs. project management

Product Management

Back
Overview
Product Roadmaps
Product Manager
Tips for new product managers
Roadmaps
Tips for presenting product roadmaps
Requirements
How to prioritize features using NPS
Product analytics
Remote product management

Agile at scale

Back
Overview
Managing an agile portfolio
Lean portfolio management
Okrs
Long-term agile planning
What is SAFe?
Spotify model
Organizational agility with Scrum@Scale
Scaling agile with Rosetta Stone
Agile iron triangle
The Large-Scale Scrum (LeSS) framework
Using Improvement Kata to support lean
Beyond the basics whitepaper

Software development

Back
Overview
Developer
Dev managers vs scrum masters
Git
Branching
Git branching video
Code reviews
Release
Stress free release
Technical debt
Testing
Incident response
Continuous integration

Design

Back
Overview
Product design process customer interview
Collaborative design in agile teams video

Agile marketing

Back
Overview
What is Agile Marketing?
How to create an agile marketing team

The agile advantage

Back
Overview
Connecting business strategy to development reality
Agile is a competitive advantage
Cultivating an agile mindset
Going agile
DevOps

Agile Teams

Back
Overview
Remote teams
Working with specialists
Release ready teams
Agilent’s agile transformation journey
Advanced Roadmaps
How Twitter uses Jira

Agile tutorials

Back
Overview
Jira Confluence sprint refinement
How to do scrum with Jira Software
Learn advanced scrum with Jira Software
Learn kanban with Jira Software
Learn how to use Epics in Jira Software
Learn how to create an agile board in Jira Software
Learn how to use sprints in Jira Software
Learn Versions with Jira Software
Learn Issues with Jira Software
Learn burndown charts with Jira Software
Auto-create sub-tasks and update fields in Jira
How to automatically assign issues with Jira Software Automation
How to sync epics stories with Jira Software Automation
Automatically escalate overdue issues in Jira

Agile conversations

Back
Overview
Unlocking marketing agility
The power of agile and customer insights
Think big, work small

About the Agile Coach

Back
Overview
Dan Radigan
Max Rehkopf
Claire Drumond
Laura Daly
Sherif Mansour
Martin Suntinger
All articles
Accessibility

Summary: Product analytics is the process of analyzing how users engage with a
product or service. It enables product teams to track, visualize, and analyze
user engagement and behavior data. Teams use this data to improve and optimize a
product or service.

As product managers, we take every opportunity we get to learn more about our
customers because understanding their needs is critical to building useful
products. This means conducting customer interviews, running surveys, and
examining in-product analytics. The data we glean from product analytics tells
us how users actually use the product – not what they want to do, how they think
they're using them, or even how we think they are using them.

Where software development differs, and home building could definitely benefit,
is the use of agile methodology. Agile allows multiple teams to respond to
changes, quickly. So how can agile, a method based on frequent, continuous
delivery exist with long-term, big-picture planning? Is it possible to create a
realistic forecast over a long period of time, knowing that the one constant is
change?

As a PM, questions like, "How much time do users spend with the product each
day?", "What actions do they take most?", and "Which features get used least?"
are incredibly valuable for understanding your users and give us clues as to how
to make their experience better. In this post, I'll explain what product
analytics are and why you should use them; how to gain a true understanding of
your users so you can pay off "empathy debt"; and how to use analytics to help
guide new feature development

Let’s get started!


WHAT IS PRODUCT ANALYTICS?

Product analytics is the process of analyzing how users engage with a product or
service. It enables product teams to track, visualize, and analyze user
engagement and behavior data. Teams use this data to improve and optimize a
product or service.

In order to get a quantitative understanding of what users are doing with your
product, the first step is instrumenting it with product analytics. The idea is
to fire an event for every action that a user can take in your product so you
get an aggregated view of how many users use a feature, and how often they're
using it. For example, if you want to track the number of times a user clicks a
specific button, you might fire an event called "big-red-button.click." From
there you can see which features need work, which are your most important, and
use that information to prioritize changes. 


ProTip:

There are a ton of solutions out there that give you a framework for adding
analytics events and tracking them. Check out Google Analytics or KISSmetrics as
a starting point.

At Atlassian, we've tried to make it as easy as possible for everyone to get at
data and be able to run their own queries and reports. We use some internally
developed tools to provide these services, but tools like Google Analytics will
get you started too. This has lead to everyone, from developers to PMs to
design, asking questions about usage and trying to understand the impact of what
we build.


“EMPATHY DEBT”: THE NEWEST KIND OF DEBT

Lets try out this new term, “empathy debt.”

Empathy debt: a gauge of whether you understand your users and how they use your
product.

In-product analytics can help you pay off empathy debt in two ways: with
qualitative feedback gathered through activities like concept testing and
customer interviews; and with quantitative data collected in-product with things
like product analytics and NPS surveys.

As an example, Confluence has been around for a fairly long time now and it has
a lot of features that have little to no analytics. One of those is the
dashboard, which is the beginning of most people's journey with Confluence. We
had some feedback about the dashboard from customer interviews, but we didn't
have all the product analytics needed to really understand usage from a
quantitative perspective. We had a lot of unanswered questions, like:

 * How much usage does the dashboard get? How many times do people visit the
   dashboard in a typical Confluence session?
 * What do people actually use the dashboard for? The All Updates feed? The
   Popular feed? Navigating to a space?
 * What do people want on the dashboard? Can we determine the best things to
   surface based on what people do after visiting the dashboard?

These are some pretty fundamental questions that we needed answers to before
embarking on a change to one of the most visited pages in Confluence. If you
don't have analytics in your product, or even a specific feature you're looking
to change, then you're in the same boat and should be very wary about making any
decisions. It's time to pay off that empathy debt!

In our dashboard testing, we learned that one of the most common actions taken
on the dashboard was viewing "favorite pages." This was a super important
finding and one that wasn't necessarily in our initial hypothesis. This brings
us to the main takeaway here: Pay off your empathy debt as soon as you can – if
you don't have analytics in your product, add them in ASAP and start using data
to help inform your product decisions. Otherwise, you'll make important
decisions in the dark. And remember that analytics don't lie! They show us
exactly what users do with the product, but try and dig a bit deeper and use
analytics to understand what users really want.


TESTING THE FUTURE BEFORE IT'S HERE

While adding product analytics can be valuable for understanding how users use
existing features, they're also extremely valuable for testing new features and
experiences. If you have a clear goal for how much you want your feature to be
used, having product analytics helps you work towards that old agile mantra of
failing fast and iterating until you succeed.

The process that we use generally looks like this:

 * Define a clear hypothesis for a product change – e.g. "By increasing the size
   of the comment box we expect to see a 5% increase in commenting."
 * Build the cheapest possible implementation of this change, loaded with any
   analytics events we need, that will allow us to test our hypothesis.
 * Deploy the change to a subset of customers in an A/B test.
 * Twiddle our thumbs while we wait for results.
 * Do a breakdown of the results, with the help of an analyst in the case of
   more complex changes, and decide whether the change was successful.

For our dashboard changes we ended up designing three very "opinionated"
dashboards, each promoting a different use case and set of behaviours. We ran
them through this process (though our hypothesis was somewhat more complicated)
and it worked worked really well for us. But there are some common gotchas we've
learned – sometimes the hard way – that you'll want to think about before
testing new features this way.

Some anti-patterns to watch out for:
 * There's nothing worse than getting to the end of an experiment and realizing
   you don't have all the events you need... Try to do your analysis before you
   run the experiment using some dummy data, you'll quickly see any gaps in what
   you're capturing.
 * Coming up with a hypothesis can be time consuming, but you need to make sure
   you have one and that you're confident you can prove or disprove it with the
   product analytics you have before you launch. Doing an analysis on dummy data
   before launching will help you test this, too.
 * Make sure you're testing on enough users and for a long enough period of
   time. You want to make sure your results are statistically significant.
 * Be prepared to throw away bad ideas! As I mentioned, you want to test
   features out as cheaply as possible and run these tests as quickly as
   possible. Failing fast is good. 


JUST DON’T FORGET TO LISTEN TO YOUR USERS, TOO

As I mentioned above, it’s great to be data-informed, but being entirely
data-driven can sometimes leave you blind to the overall experience that you’re
creating for users. Being dependent entirely on data can also be a bit crippling
when it comes time to make a decision and you don’t have all the data you need.



Product analytics expose the raw reality of how people use the product, or even
a particular feature, but it can be very one-dimensional. Combining what you
think you know from product analytics data with qualitative feedback in customer
interviews, concept testing workshops, and sparring will give you a more
complete picture of what's happening so you can build the best product possible.

TRY JIRA PRODUCT DISCOVERY FOR FREE

Get it free
Share this article
 * 
 * 
 * 

Sam Tardif

I'm a developer-cum-growth-hacker-cum-developer-again, now leading the
Confluence team. At work, my passions are data-driven product development and
simple, elegant products. Outside of work I stay away from data, spending more
time with puppies and making my way through every Japanese restaurant Sydney has
to offer.

Related tutorial
Create an agile board in Jira Software
Try this tutorial
Subscribe

Sign up for more articles

Email




Thanks for signing up!

Tutorial

CREATE AN AGILE BOARD IN JIRA SOFTWARE

Find out how to create agile boards in Jira software with this step-by-step
guide. Set up agile and jira automation to keep up to date seamlessly.

Try this tutorial
article

HOW TO BUILD A KICK-ASS AGILE TEAM

A high-functioning agile team requires a solid foundation, collaboration, and
cultivation of team dynamics and unique culture. Read more here.

Read this article
 * 
 * 
 * 

Up Next
Remote product management
Agile Topics
Agile project management
Scrum
Kanban
Design
Software development
Product management
Teams
Agile at scale
DevOps

Sign up for more agile articles and tutorials.

Email




Thanks for signing up!

Languages
Choose your language Deutsch English Español Français Italiano 한국어 Magyar
Nederlands 日本語 Polski Português русский 中文
Privacy policy
Terms
Impressum

Copyright © 2022 Atlassian

 * 
 * 
 * 
 * 

This site uses cookies to improve your browsing experience, perform analytics
and research, and conduct advertising. To change your preferences, click Cookie
Settings. Otherwise, clicking Accept all Cookies indicates you agree to our use
of cookies on your device.Atlassian Cookies and Tracking Notice

> Cookie Settings Accept All Cookies