{"id":3405,"date":"2019-04-23T19:40:34","date_gmt":"2019-04-23T19:40:34","guid":{"rendered":"https:\/\/blog.qualaroo.com\/?p=3405"},"modified":"2026-07-03T10:39:49","modified_gmt":"2026-07-03T10:39:49","slug":"automate-your-user-research-for-long-term-viability-and-a-better-bottom-line","status":"publish","type":"post","link":"https:\/\/web-staging.qualaroo.com\/blog\/automate-your-user-research-for-long-term-viability-and-a-better-bottom-line\/","title":{"rendered":"Automate User Research for Long-Term Viability and a Better Bottom Line"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\"><em>This post originally appeared on <a href=\"https:\/\/www.designinnovationglobal.com\/events-design-thinking\/blog\/automate-your-user-research-for-long-term-viability-and-a-better-bottom-line\">Design Thinking<\/a> and was written by Paulina W\u00f3jciak and Sarah Cantu.<\/em> <\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Not too long ago, \u201cstreaming\u201d music meant listening to the radio or watching music videos on MTV. &nbsp;If you really loved an artist, you would pay between $10 and $20 for a tape or CD and listen to their entire album. <\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Then, when iTunes and iPods became popular, it changed the way people listened to music. Listeners could actually pick and choose which songs they wanted to buy without having to commit to purchasing an entire album. <\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Just a few years later, Spotify and other streaming services began to again reinvent the way people consume music. Founded in 2008, Spotify disrupted the music industry by allowing users to stream songs instead of owning digital copies. In 2015, Apple Music was launched and other services (like Tidal, launched in 2014) have evolved to provide similar offerings. <\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/lh3.googleusercontent.com\/rcK2oMpb1AT6cbJphIn5k0fPasn25M0xZz8KX8AGoU5Aq0damsF52chttVFGKP8Tl7X9rJmQJ9pFX__F0V5Rrda8uB8YLBHTa2zEzjU2RtCw7iT1f2Kfhf4c6Fh0HFAMI8zqXL1n\" alt=\"Screen\"\/><figcaption><a href=\"https:\/\/www.statista.com\/statistics\/186304\/revenue-distribution-in-the-us-music-industry\/\">Music industry revenue data via Statista<\/a><br><br><\/figcaption><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">From 2017 to 2018, <a href=\"https:\/\/www.statista.com\/statistics\/186304\/revenue-distribution-in-the-us-music-industry\/\">Statista<\/a> reports that streaming music jumped up by 10% in terms of its share of US music industry revenue. <strong>It pays to listen to your users. <\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">If Apple had chosen to rest on the success they had with iPods and iTunes, they would not be able to hold a candle to Spotify\u2019s market share. We know this is true because digital downloads represented 11% of US music industry revenue in 2018 while streaming held 75%. But instead of sticking to something that had worked for them in the past, Apple evolved with the demands of their market. <\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Evolve_or_Die\"><\/span>Evolve or Die <span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Apple was smart to jump on the wave of music streaming, even if they\u2019re not quite the \u201ccategory king.\u201d But what happens to companies who aren\u2019t so quick on the draw and don\u2019t adapt to their users\u2019 needs and desires? They die. Slowly and expensively. Just ask giants of years past like Nokia, Blackberry, and AOL. The market\u2019s message is clear: evolve to your users&#8217; needs or get left behind. <\/p>\n\n\n\n<p class=\"wp-block-paragraph\">This challenge is perhaps compounded by the rise of automation, which has begun to touch more and more of our everyday lives. From smarter recommendations on our favorite content streaming apps like Spotify and Netflix to cars that update their own software, our technology is only getting smarter, faster, and stronger. So understanding your users is necessary to stand out from competitors and provide real value. <\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Knowing and adapting to your customer requires user research &#8211; every successful company knows this. However, it seems that user research and user experience departments are still figuring out how to claim their seat at the executive table when it comes to major business decisions. <\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Maybe this is because UX is a relatively new discipline and research is a heavy, heavy word. Many companies seem to avoid user research altogether because of the associated mental hurdles: budget, time, and personnel limitations. &nbsp;Other <a href=\"https:\/\/uxdesign.cc\/most-common-excuses-for-not-doing-user-research-6c7eec5076ee\">popular excuses<\/a> for not conducting user research include lack of expertise and difficulty recruiting the right type of user. <\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Inclusive testing has real value, edge cases and unfamiliar users often surface friction your core audience has learned to work around. But inclusivity isn&#8217;t a substitute for relevance. For a specialized product, most of your sample still needs to match your actual target profile and use case. Widen the pool to catch blind spots, don&#8217;t widen it so far that your findings stop reflecting who will actually buy the product.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"User_Research_as_Both_the_Answer_and_the_Hurdle\"><\/span>User Research as Both the Answer and the Hurdle <span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">According to <a href=\"https:\/\/www.nngroup.com\/articles\/100-years-ux\/\">Nielsen Norman Group<\/a>, the \u201cdawn of UX\u201d actually happened before the term itself was coined. During its inception, user research was time and resource intensive. It typically took place in very formal settings and in tightly controlled environments. <\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/lh5.googleusercontent.com\/49AR8x-ogrfrzeObZN7aL05j2CIf-RhzrrskktAAMkY7qI8uASBewSze5pI17-pXMMfBXbuMo4XL6tcak8nunyZquFuJN9EP91MXChzJvPpGNlRw3A6IOasEwlpWNyXzP8meFnMC\" alt=\"Screen\"\/><figcaption><em>How companies picture user research (probably) <\/em><br><br><\/figcaption><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">Over time, some aspects of conducting user research have become increasingly accessible. In particular, <a href=\"https:\/\/qualaroo.com\/blog\/recruiting-user-research-participants-with-qualaroo\/\">recruiting participants for user research<\/a> became much easier using online tools. However, the actual process of conducting user research still had a way to go in terms of becoming more efficient and scalable while maintaining quality. <\/p>\n\n\n\n<p class=\"wp-block-paragraph\">One of the core aspects of user research that makes it difficult to scale is its qualitative nature. If you\u2019re manually sorting through hundreds of comments from your users, it\u2019s not easy to draw conclusions in a systematic way. However, with the rise of automation, manually collecting and sorting through qualitative data doesn\u2019t have to be your only option. <\/p>\n\n\n\n<figure class=\"wp-block-embed-youtube wp-block-embed is-type-video is-provider-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"How to Create a User Research Survey\" width=\"1120\" height=\"630\" src=\"https:\/\/www.youtube.com\/embed\/uAw1tA9yRZw?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"What_Automation_Actually_Replaces_and_What_It_Doesnt\"><\/span>What Automation Actually Replaces, and What It Doesn&#8217;t<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">It&#8217;s worth being precise here, because &#8220;automate user research&#8221; gets used loosely. Automation is genuinely good at:<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>Triggering feedback collection at the right moment, based on behavior or lifecycle stage<\/li><li>Routing responses to the right team or dashboard without manual sorting<\/li><li>Tagging and clustering open-text responses at a volume no team could read manually<\/li><li>Surfacing patterns across hundreds or thousands of responses in minutes instead of weeks<\/li><\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">What it doesn&#8217;t replace:<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>Deciding what question to ask and why it matters to the business<\/li><li>Discovery work that uncovers problems users haven&#8217;t articulated yet<\/li><li>Usability testing, where you need to watch someone struggle, not just read that they struggled<\/li><li>One-on-one interviews, where follow-up questions depend on what the person just said<\/li><li>Synthesizing findings into a decision, and owning the follow-through<\/li><\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">Automated feedback collection is one input into user research. It&#8217;s not a replacement for the strategy, planning, and judgment that make research useful in the first place.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Automation_is_Transforming_User_Research_and_UX\"><\/span>Automation is Transforming User Research and UX <span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">You don\u2019t need us to tell you that automation is transforming industries all across the board. From <a href=\"https:\/\/www.tesla.com\/autopilot\">self-driving Teslas<\/a> to building wealth with <a href=\"https:\/\/www.nerdwallet.com\/blog\/investing\/best-robo-advisors\/\">robo-investing<\/a>, automation is clearly the future of tech, but it\u2019s not all fun and games.<strong> <\/strong>Thankfully, we\u2019re no longer relegated to conducting user research in tightly controlled environments. With the rise of automation, many business practices (and experiences) can be automated, and user research is one activity that benefits from this trend in a big way. <\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The more that you know about your users, the more you can also collect feedback from very specific segments and leverage smart triggers to make the feedback collection dynamic and responsive. This type of feedback collection powered with personalization gives you the ability to tailor your experience and accelerate product adoption. For example, automated recommendations in Netflix keep users interested and engaged. <\/p>\n\n\n\n<p class=\"wp-block-paragraph\">If you\u2019ve ever browsed through your Netflix recommendations, you may have noticed a percentage included on individual title listings. This percentage indicates Netflix\u2019s forecasted odds of whether or not you\u2019ll enjoy a title. <\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/lh3.googleusercontent.com\/Mzr_j9Iy5Z88uF7PevLWJuj4ZAQrDyuLctyn-5C8r1LIGDGnMcXmpQIOWgkPc-wZxUUkxGyhwqVICVCI6xdlI3p3Y1d39NYKIvZFdzvH0Rjod9uq9QRnTm_aM_QfUMmOnnwWad8F\" alt=\"Screen\"\/><figcaption><a href=\"https:\/\/www.youtube.com\/watch?time_continue=16&amp;v=as4pZhodG5I\"><em>Screencap via Netflix\u2019s Thumbs Announcement.<\/em><\/a><br><br><\/figcaption><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">However, Netflix\u2019s personalization strategy goes beyond just the recommendations you see. <a href=\"https:\/\/help.netflix.com\/en\/node\/100639\">Their alogrithm also personalizes<\/a> factors like the order of titles in each row and what titles appear in which row. Why does Netflix invest so much in getting recommendations right? Because they know that the better content they have, the more addictive their service will be, and the more money they can make off subscriptions. <\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/lh3.googleusercontent.com\/t_wCD9Rbi5r4WDK1r-KqpU7-_e74gFLNaBl1yjZuzoS9NFWgi96WnzxWiIIt_JVcLr9kXzcuNfaC_sKvzW2ePirTl9Bmp0zZTnqAeCHbo3Dfl4-L31TQxF3Dah5CK8nFKgdwJSkF\" alt=\"Screen\"\/><figcaption><a href=\"https:\/\/www.forbes.com\/sites\/louiscolumbus\/2018\/07\/12\/10-charts-that-will-change-your-perspective-of-netflixs-massive-success-in-the-cloud\/#409166542303\"><em>Netflix&#8217;s Revenue Growth and Predictions via Forbes<\/em><\/a><br><br><\/figcaption><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">Automating and personalizing the user experience has paid off for Netflix as we can see by their massive growth, and it\u2019s only predicted to continue working. It pays to listen to your users and improve their experience accordingly. <\/p>\n\n\n\n<p class=\"wp-block-paragraph\">But content streaming isn\u2019t the only industry realizing big gains from automation. Automation can also play an important role in the design process for different types of businesses. For example, <a href=\"https:\/\/airbnb.design\/sketching-interfaces\/\">Airbnb<\/a> is using AI to translate its sketches to prototypes. As they describe it, the vision is to bring testing time to 0. <\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/lh4.googleusercontent.com\/T8G6mBbD8dktkUOrEE_MGiVhkuLl-UjqXIh0M8Ya275x3bZ2yMgPvLRUej0oDLje4p7oRhMwHsL72K01K-ofHK1jsxaekakxfXAVvmprhZo0XcJNsDn2dCgXXTJohAoymjNrwR0N\" alt=\"Screen\"\/><figcaption><a href=\"https:\/\/airbnb.design\/sketching-interfaces\/\">Automated sketch to prototype example from Airbnb Design. <\/a><br><br><\/figcaption><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">By translating sketches to prototypes so quickly, the company is moving closer to being able to very quickly validate or disprove ideas. This can save lots of time and effort in problem-solving and design time. <\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The same shift is happening inside research operations itself, beyond just collecting feedback. <\/p>\n\n\n\n<p class=\"wp-block-paragraph\">AI-assisted transcription turns hours of interview recordings into searchable text in minutes. Semantic clustering groups open-text responses by theme automatically, instead of a researcher manually coding each one. <\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Repository search lets teams query past studies in plain language, so insights from 6 months ago are reused rather than forgotten in a shared drive. <\/p>\n\n\n\n<p class=\"wp-block-paragraph\">AI-assisted tagging applies consistent labels to thousands of responses, freeing researchers to spend their time on interpretation rather than data entry.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">These tools speed up the mechanical parts of research. They don&#8217;t decide what&#8217;s worth researching or what a finding means. That&#8217;s still the researcher&#8217;s job.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Automation can help you improve your products and your design process. <\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/qualaroo.com\/\">Automating user research<\/a> can have a major impact on your bottom line and encourage higher-value interactions with your users. <\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Automated_User_Research_Better_Bottom_Line\"><\/span>Automated User Research = Better Bottom Line<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">User research is important and it\u2019s more accessible now than it has been in the past. But it\u2019s also more time-sensitive than you may think. Why? Because user research can have a major impact on all functions of your company, including:<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>For one, actionable user research can increase the stickiness of your product, increasing its long-term viability. <\/li><li>User research can feed your roadmap and can help you decide which features and functionalities are worth implementing and which are not. <\/li><li>Gathering user feedback empowers you to improve the user experience and helps you retain more customers. <\/li><\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">Automating the collection and sorting of feedback does cut down on manual hours. It doesn&#8217;t remove the need for planning, sampling decisions, interpretation, and someone accountable for acting on what you find. <\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Treat automation as a way to free up your team&#8217;s time for that higher-judgment work, not a way to skip it.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"What_Automation_Can_Get_Wrong_If_Youre_Not_Watching\"><\/span>What Automation Can Get Wrong If You&#8217;re Not Watching<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Speed cuts both ways. The same automation that makes feedback collection effortless can also scale up bad data just as fast. Watch for:<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>Sampling bias: Automated triggers tend to catch whoever&#8217;s active at that moment, not a representative slice of your full user base. Check who&#8217;s actually responding before you trust the pattern.<\/li><li>Poor targeting: A trigger fired to the wrong segment produces confident-looking data that answers the wrong question.<\/li><li>Low-quality responses: Frictionless collection can mean frictionless answers. More responses isn&#8217;t automatically better data.<\/li><li>Over-surveying: Automated triggers don&#8217;t get tired of asking. Your users do. Set frequency caps and suppression windows so the same person isn&#8217;t hit repeatedly.<\/li><li>False confidence: A clean dashboard and a clustered theme report can look more authoritative than they are. Automated synthesis still needs a human sanity check before it drives a roadmap decision.<\/li><\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">There&#8217;s also a governance layer that&#8217;s easy to skip when automation makes collection this frictionless. <\/p>\n\n\n\n<p class=\"wp-block-paragraph\">If you&#8217;re triggering feedback based on behavior, tying responses to identity, or feeding transcripts into an AI tool for tagging, that&#8217;s personal data moving through systems your users didn&#8217;t necessarily know about. <\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Disclose what you&#8217;re collecting and why, get consent where it&#8217;s required, and set a retention policy for how long response data and recordings stick around. None of this slows automation down much. Skipping it creates a bigger problem later.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The fix for all of these is the same: validate what the automated feedback tells you against behavioral or operational data, actual usage, conversion, retention, and support tickets, before you act on it.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Throw_Out_Your_Lab_Coat_Automate_Your_User_Research\"><\/span><strong>Throw Out Your Lab Coat, Automate Your User Research <\/strong><span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Automation changes what your team spends time on, not whether research still takes effort. <\/p>\n\n\n\n<p class=\"wp-block-paragraph\">It hands you feedback faster, sorted and clustered instead of buried in a spreadsheet, so your researchers spend less time on data entry and more time on the parts that actually require judgment: deciding what matters, validating it against real behavior, and turning it into a decision. <\/p>\n\n\n\n<p class=\"wp-block-paragraph\">That shift, not the removal of effort, is what makes automated feedback collection worth building into your research process.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>This post originally appeared on Design Thinking and was written by Paulina W\u00f3jciak and Sarah Cantu. Not too long ago, \u201cstreaming\u201d music meant listening to the radio or watching music videos on MTV. &nbsp;If you really loved an artist, you would pay between $10 and $20 for a tape or CD and listen to their&#8230;<\/p>\n","protected":false},"author":21,"featured_media":3410,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-3405","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/web-staging.qualaroo.com\/blog\/wp-json\/wp\/v2\/posts\/3405","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/web-staging.qualaroo.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/web-staging.qualaroo.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/web-staging.qualaroo.com\/blog\/wp-json\/wp\/v2\/users\/21"}],"replies":[{"embeddable":true,"href":"https:\/\/web-staging.qualaroo.com\/blog\/wp-json\/wp\/v2\/comments?post=3405"}],"version-history":[{"count":12,"href":"https:\/\/web-staging.qualaroo.com\/blog\/wp-json\/wp\/v2\/posts\/3405\/revisions"}],"predecessor-version":[{"id":25331,"href":"https:\/\/web-staging.qualaroo.com\/blog\/wp-json\/wp\/v2\/posts\/3405\/revisions\/25331"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/web-staging.qualaroo.com\/blog\/wp-json\/wp\/v2\/media\/3410"}],"wp:attachment":[{"href":"https:\/\/web-staging.qualaroo.com\/blog\/wp-json\/wp\/v2\/media?parent=3405"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/web-staging.qualaroo.com\/blog\/wp-json\/wp\/v2\/categories?post=3405"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/web-staging.qualaroo.com\/blog\/wp-json\/wp\/v2\/tags?post=3405"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}