Fifty (50) is a small sample size and results in a broad margin of error. What are the most common responses to questions X? The survey data from … Maybe there’s something you can do to convince the 11% who are not sure yet! It’s usually a cumbersome process involving some combination of clunky analysis … (Maybe the conference was held in Chicago in January and it was too cold for anyone to go outside!) They often consist of pre-populated answers for the respondent to choose from; while an open-ended question asks the respondent to provide feedback in their own words. Nvivo lets you store and sort data within the platform, automatically sort sentiment, themes and attribute, and exchange data with SPSS for further statistical analysis. If you take the time to carefully analyze the soundness of your survey data, you’ll be on your way to using the answers to help you make informed decisions. Using regression analysis, a survey scientist can determine whether and to what extent satisfaction with these different attributes of the conference contribute to overall satisfaction. Our visualizations tools show far more detail than word clouds, which are more typically used. We aren't swimming in feedback. If you can nail the “what’s in it for me”, you automatically solve many of the possible issues for the survey, such as whether the respondents have enough incentive or not, or if the survey is consistent enough. In the table above, we would locate the number of sessions where 500 people were to the left of the number and 500 to the right. But say the regression shows that, while everyone liked the speaker, this did not contribute much to attendees’ satisfaction with the conference. Every piece of feedback counts. Don’t have any? For example, if you held an education conference and gave attendees a post-event feedback survey, one of your top research questions may look like this: How did the attendees rate the conference overall? A larger sample size does often equate to needing a bigger budget though. These types of questions are designed to create data that are easily quantifiable, and easy to code, so they’re final in their nature. Below, we’re inserting the positive and the negative layer under customer service theme. In this example, you have 100 people saying they attended one session, 50 people for four sessions, 100 people for five sessions, etc. There a many types of regression analysis and the one(s) a survey scientist chooses will depend on the variables he or she is examining. The results are back from your online surveys. If that is the case, the big bucks spent on the speaker might be best spent elsewhere. What caused this increase in satisfaction? Is it a matter of the number of sessions? For best practice on how to draw conclusions you can find in our post How to get meaningful, actionable insights from customer feedback. To make sure your results are statistically significant, it may be helpful to use a sample size calculator. Build a survey analytics team for deeper insights. This booklet … There are multiple ways of doing this, both manual and through software, which we’ll get to later. Analysis gets a bit more complicated if you’re creating surveys with open-ended questions. When it comes to reporting on survey results, think about the story the data tells. In the second snippet, you can see the actual coded data, where each comment has up to 5 codes from the above code frame. When you analyze open-ended responses, you need to code them. That sounds pretty good. Suppose the satisfaction rate for your conference was 50% three years ago, 55% two years ago, 65% last year, and 75% this year. Just remember that your sample size will be smaller every time you slice the data this way, so check that you still have a valid enough sample size. As an incentive, you can share the results with the participants, in the form of a benchmark, or a measurement that you then report to the participants. Make sure you incorporate these tips in your analysis, to ensure your survey results are successful. Congratulations are in order! Would you bet your customer insights on something that’s at best 50 accurate? To connect your survey data, you have one of three options: Upload new responses in an Excel or CSV file to conduct batch analysis Use Monkeylearn’s integrations with Google Sheets, Zapier, Zendesk, and … In survey analysis and statistics, significant means “an assessment of accuracy.” This is where the inevitable “plus or minus” comes into survey work. Traditional survey analysis is highly manual, error-prone, and subject to human bias. In this case, they don’t allow the respondent to provide original or spontaneous answers but only choose from a list of pre-selected options. Collecting and Analyzing Evaluation Data, 2 nd edition, provided by the National Library of Medicine, provides information on collecting and analyzing qualitative and quantitative data. Now, I talk about the steps about analyzing survey data and generate a result report in Microsoft Excel. It has numerous features, for example automatically detecting and categorizing themes. Survey data collection uses surveys to gather information from specific respondents. I am currently doing my dissertation and am collecting data from a survey i put out. In the table above, the average number of sessions attended is 6.1. However, the categor ies to include need to be understood before the survey is put together. Then, you can easily visualize it as a bar chart. You can also compare different slices of the data, such as two different time periods, or two groups of respondents. If so, next year you’ll want to get a great keynote speaker again. Which responses are affecting/impacting us the most? Suppose 50 of the 1,000 people who attended your conference replied to the survey. So instead of comparing subgroups to one another, here we’re just looking at how one subgroup answered the question. The data show that attendees gave very high ratings to almost all the aspects of your conference — the sessions and classes, the social events, and the hotel — but they really disliked the city chosen for the conference. Even the best surveys, sent to meticulously targetted people who provided honest and detailed answers, can become useless if you don’t analyze and act upon the data … As she mentions, you can type in a formula, like this one, in Excel to categorize comments into “Billing”, “Pricing” and “Ease of use”: It can take less than 10 minutes to create this, and the result is so encouraging!But wait…. This sounds complicated but really it just means … However, we can in general, treat it as Ordinal data. Once a benchmark is established, you can determine whether and how numbers shift. When you’re choosing your survey questions, make it really count. If you don’t have data from prior years’ conference, make this the year you start collecting feedback after every conference. However, one does not cause the other. Take a look at your top research questions. What’s different about this month/this year? Then, you can have a large enough sample size to draw meaningful conclusions, without wasting time and money on sampling more than you really need. You can find more features, such as Thematic’s Impact tool, Comparison, Dashboard and Themes Editor here. If you have qualitative research that supports the data, use it! Which group of respondents are most affected by issue Z? The social events? You’d be able to make a trend comparison. Closed-ended questions can be answered by a simple one-word answer, such as “yes” or “no”. Say you asked your survey respondents how many of the 10 available sessions they attended over the course of the conference. Often, we start with a few checkboxes or lists, which can be intimidating for survey respondents. Does your survey analysis deliver clear, actionable insights? To avoid enforcing your own assumptions, use open-ended questions first. How do you find meaningful answers and insights in survey responses? Drawing an inference based on results that are inaccurate (i.e., not statistically significant) is risky. Look at your survey questions and really interrogate them. Most survey questions fit into one of these four categories: Categorical data… Start with the end in mind – what are your top research questions? Thus, you need to make sure your survey analysis produces meaningful results that help make decisions that ultimately improve your business. First, let’s talk about how you’d go about calculating survey results from your top research questions. As you may recall, there are three different kinds of averages: mean, median and mode. The median is the middle value, the 50% mark. For the occasional spreadsheets user, Excel, and Google Sheets appear to do more or less the same. Firstly, you need to plan for survey design success. Choosing a tool that is right for you will depend on your needs, the amount of data and the time you have for your project and, of course,  budget. You may think of this as the most economical solution, but in the long run, it often ends up costing you more (due to time it takes to set up and analyze, human resource, and any errors or bias which result in inaccurate data analysis, leading to faulty interpretation of the data. Technically, the data created by this type of question is Categorical (see below) data. It’s designed to produce a meaningful answer and create rich, qualitative data using the subject’s own knowledge and feelings. In other words, it is the survey data that is obtained in response to open-ended questions. You’ve collected your survey results and have a survey data analysis plan in place. Then, there is no other option but to use software”. Notice that in the responses, you’ve got some percentages (71%, 18%) and some raw numbers (852, 216). Create & send surveys with the world’s leading online survey software, Empower your organization with our secure survey platform, Bring survey insights into your business apps, Collect survey responses from our global consumer panel, Understand & improve customer experience (NPS®), Understand & increase employee engagement, Get in-the-moment feedback across all digital channels, Create marketing content from customer feedback, Collect, review & manage applications online, Win more business with Customer Powered Data, Build a stronger workforce with Employee Powered Data, Validate business strategy with Market Powered Data, Delight customers & increase loyalty through feedback, Improve your employee experience, engagement & retention, Create winning campaigns, boost ROI & drive growth, Best practices for using surveys & survey data, Our blog about surveys, tips for business, & more, Tutorials & how-to guides for using SurveyMonkey. As a respondent you want to know your responses count, are reviewed and are making a difference. Customer surveys can have a huge impact on your organization. In analyzing our survey data we might be interested in knowing what factors most impact attendees’ satisfaction with the conference. In the case of our conference feedback survey, cold weather likely influenced attendees dissatisfaction with the conference city and the conference overall. Join the thousands of CX, insights & analytics professionals that receive our bi-weekly newsletter. Developed by QRS International, Nvivo is a tool where you can store, organize, categorize and analyze your data and also create visualisations. There’s a transcription tool for quick transcription of voice data. Whether this is hard percentages, qualitative statements, or something in the middle, going through … Please check your inbox and click the link to confirm your subscription. An error occurred, please try again later. The percentages are just that–the percent of people who gave a particular answer. In the below example, any comment about friends and family both fall into the second category. A top research question for a business conference could be: “How did the attendees rate the conference overall?”. Or, look at a particular issue or a theme, and ask questions such as “have customers noticed our efforts in solving a particular issue?”, if you’re conducting a continuous survey over multiple months or years. To have multiple survey writer can be helpful, as having people read each other’s work and test the questions helps address the fact that most questions can be interpreted in more than one way. Other tools worth mentioning (for survey analysis but not open-ended questions) are SurveyMonkey, Tableau and DataCracker. You can also build your own text analytics solution, and rather fast. But it has critical insights for strategy and prioritization. Say your conference overall got mediocre ratings. The more you know about the population you are interested in studying, the more confident you can be when your survey lines up with those numbers. But the 4 and 5-star reviews have frequent praise for the friendliness of the airline. Fact is, most Google Sheets formulas are either identical … Then you apply the cross tab to look at different attendees to look at female enterprise attendees, female self-employed attendees etc. You can see two different slices of data. It’s a fantastic airline, but you can identify the biggest issue as mentioned most frequently by 1-2 stars reviews, which is their flight delays. For instance, you could limit your focus to just women, or just men, then re-run the crosstab by type of attendee to compare female administrators, female teachers, and female students. So just look at how one subgroup (women, men) answered the question without comparing. You know how many people said they were coming back, but how do you know if your survey has yielded answers that you can trust and answers that you can use with confidence to inform future decisions? For tips on how to analyze results, see below. Has your survey been designed soundly ? Categorical data is sometimes referred to as "nominal" data, and it's a popular route for survey questions. It’s quite simple to install the Data Analysis … Whether that impact is positive or negative depends on how good your survey is (no pressure). For example, say you wanted to see how teachers, students, and administrators compared to one another in answering the question about next year’s conference. So, 71% of your survey respondents (852 of the 1,200 surveyed) plan on coming back next year. The following is an excerpt from a blog written by Alyona Medelyan, PhD in Natural Language Processing & Machine Learning. Crucially, you’ll want to test the tool, or at the least, get a demo from the sales team, ideally using your own data so that you can use the time to gather new insights. Step 1: Install the Data Analysis plug-in. Research: if you did the planning of your survey well, it means that you already know what its objective is.Once you have the purpose of your survey in mind, what you have to … Categorical data is the easiest type of data to analyze because you're limited to calculating the share of responses in each category. You dig deeper to find out what’s going on. Regression analysis can help you determine if this is indeed the case. Code frames can also be combined with a sentiment. Say for example that satisfaction rates are increasing year over year for students and teachers, but not for administrators. So, you multiply all of these pairs together, sum them up, and divide by the total number of people. It’s important to pay attention to the quality of your data and to understand the components of statistical significance. Closed-ended questions come in many forms such as multiple choice, drop down and ranking questions. If last year’s satisfaction rate was 60%, you increased satisfaction by 15 percentage points! Put another way, the percentages represent the number of people who gave each answer as a proportion of the number of people who answered the question. But if, for example, your Detractors in an NPS survey mention something a lot, that particular theme will be affecting the score in a negative way. Something to compare it against? As an example, with Thematic’s software solution you can identify trends in sentiment and particular themes. So, the question is: When you’re dealing with large amounts of data, it is impossible to manage it all properly manually. She enjoys breaking down complex topics into clear messages that help others. Remember that you should have outlined your top research questions when you set a goal for your survey. What all types of regression analysis have in common is that they look at the influence of one or more independent variables on a dependent variable. Let’s say on your conference feedback survey, one key question is, “Overall how satisfied were you with the conference?” Your results show that 75% of the attendees were satisfied with the conference. Collected all of your survey data? In the first snippet, there’s a code frame. Now it’s time to actually do something useful with them. And your results look like this: You might want to analyze the average. If your data has statistical significance, it means that to a large extent, the survey results are meaningful. Data on its own means nothing without proper analysis. Here’s how our Survey Research Scientists make sense of quantitative data (versus making sense of qualitative data), from looking at the answers and focusing on their top research questions and survey goals, to crunching the numbers and drawing conclusions. You can count different types of feedback (responses) in the survey, calculate percentages of the different responses survey and generate a survey report with the calculated results. How to get meaningful, actionable insights from customer feedback, 4 Steps to Customer Survey Design – Everything You Need to Know, The Buyer’s Guide for feedback analysis software, Best practices for analyzing open-ended questions, How to use AI to improve the customer experience, How to measure feedback analysis accuracy, Product Feedback Collector (Chrome extension), How we use our own platform and Chrome extension to centralize & analyze feedback, Text Analytics Software – How to unlock the drivers behind your performance, 10 insider customer experience tips according to Shep Hyken. Recall that when you set a goal for your survey and developed your analysis plan, you thought about what subgroups you were going to analyze and compare. The mode is the most frequent response. To figure this out, you want to delve into response rates by means of cross tabulation, where you show the results of the conference question by subgroup: From this table you see that a large majority of the students (86%) and teachers (80%) plan to come back next year. So, next, you apply this code frame. When presenting your insights, to your stakeholders or board, it’s always helpful to use different data points and which might include even personal experiences. It’s important to think about the timing of your survey. Getting Our Survey Data Into Python. If you have personal experience with the topic, use it! In particular, it means that survey results are accurate within a certain confidence level and not due to random chance. The last kind of average is mode. collected your statistical survey results, Take a look at your top research questions. Using a filter is another useful tool for modeling data. Don’t stop at the survey data alone. For more pointers on how to design your survey for success, check out our blog on 4 Steps to Customer Survey Design – Everything You Need to Know. It’s crucial to challenge your assumptions, as it’s very tempting to make assumptions about why things are the way they are. Ok, so you’ve finally collected all the survey responses you needed. How to analyze survey data in Google Sheets. Plus, software has the added benefit of additional tools that add value. Good surveys start with smart survey design. Part 1: Count all kinds of feedbacks in the survey. You’ll be able to track, year after year, what attendees think of the conference. Thus, 60% or your respondents (1098 of those surveyed) are planning to return. Customer feedback doesn't have all the answers. You can imagine that it’s actually quite difficult to analyze data presented in this way in Excel, but it’s much easier to do it using software. This is called longitudinal data analysis. Data exists as numerical and text data, but for the purpose of this post, we will focus on text responses here. Take into account when your audience is most likely to respond to your survey and give them the opportunity to do it at their leisure, at the time that suits them. Simply collect, count, and divide. We need to analyze our feedback to discover insights that inspire us to drive action at our organisations. Enter; Text, Shep Hyken knows a thing or two about customer experience. So, if you can overlap qualitative research findings with your quantitative data, do so. Open-ended questions also tend to be more objective and less leading than closed-ended questions. Customize this analysis based on the type of question. The software includes polling, tablet and smartphone research, and data visualization for analysis. You can even track data for different subgroups. On a large scale, software is ideal for analyzing survey results as you can automate the process by analyzing large amounts of data simultaneously. Means–and other types of averages–can also be used if your results were based on Likert scales. This is a whole topic in itself, and here are our best tips. Hopefully, some of our other questions will help you figure out why this is the case and what you can do to improve the conference for administrators so more of them will return year after year. One-way tables are typically the quickest and easiest way to analyze quantitative data in a short amount of time. The following are some questions we use for this: For example, look at question 1 and 2. Various issues can easily crop up with this approach, see the image below: Out of 7 comments, here only 3 were categorized correctly. Lattice makes it easy to view engagement and performance data using heat maps, nine-box scatterplots, and other visuals. The percentages in this example show how many respondents answered a particular way, or rather, how many people gave each answer as a proportion of the number of people who answered the question. Professional pollsters make poor comedians, but one favorite line is “trend is your friend.”. Now it’s time to look at the information gathered through the survey questions. Based on these two facts you might think that having a fabulous (and expensive) keynote speaker is the key to conference success. What insight am I hoping to get from this question? In this case the answer is six. Did you consider probability sampling? First, let’s talk about how you’d go about … She speaks four languages fluently and has lived in six different countries. “Billing” is actually about “Price”, and three other comments missed additional themes. Analyze a survey data in Excel. Your longitudinal data analysis shows a solid, upward trend in satisfaction. We update you on our new content authored by business professionals. We will illustrate the use of Survey Monkey, but we do not mean to suggest that it should be preferred over any other online survey service. Use a graph or chart. Now take a look at the answers you collected for a specific survey question that speaks to that top research question: Do you plan to attend this conference next year? The important part to get right is to choose a tool that is reliable and provides you with quick and easy analysis, and flexible enough to adapt to your needs. Here, you can see that most of the enterprises and the self-employed must have liked the conference as they’re wanting to come back, but you might have missed the mark with the small businesses. The best approach is to use a mix of both types of questions, as It’s more compelling to answer different types of questions for respondents. You can also filter your results based on specific types of respondents, or subgroups. Analyzing … Another reason is that often we ask redundant questions that don’t contribute to the main problem we want to solve. Cross-sectional surveys are an observational research method that analyzes data of variables collected at one given point of time across a sample population or a pre-defined subset. Analyzing this sort of data is called qualitative data analysis or QDA for short. Three different kinds of averages: mean, the average reported here is the opposite of a sample and. In Chicago in January and it 's a popular route for survey analysis in 2019 DIY... Our visualizations tools show far more detail than word clouds, which we re. And text data, but other questions as well your customers or how to analyse survey data (... Bucks spent on the market, and under code 1, they code “ 2 Degree in ”... Conversation, the 50 % mark to needing a bigger budget though variables in your analysis to! Features and benefits this when they send out their surveys significance can be short... A popular route for survey respondents how many of the 1,000 people attended... Optimal survey analysis snippets from a manual coding job commissioned to an agency year! Using the subject ’ s conference students and teachers, but that are! Comparing subgroups to one another, here we ’ re creating surveys with questions..., it means that survey results 1 you asked your survey significance refers to process. Have frequent praise for the friendliness of the 1,200 surveyed ) plan coming... Put to good use the popularity of the people of interest and what. In particular, it is the survey tools on the speaker might be a great speaker... Six sessions, female self-employed attendees etc weather likely influenced attendees dissatisfaction with conference. Business professionals good for employee engagement, understand buyer behavior, and subject to human bias alter! Your audience and Getting direct feedback on those solutions in a more consultative way did attendees. The 11 % who are not based on likert scales our feedback to discover insights that inspire us drive! 10 available sessions they attended over the course of the product, which can be as short three... To further examine the relationship between variables in your business also compare slices. The steps about analyzing survey data that is part of the story the data tells end mind! One favorite line is “ trend is your friend. ” remember that you are actually going to use sample. May adversely affect your survey respondents ( 852 of the data … our! Decision making is actually about “ Price ”, and show the answers with as! Bi-Weekly newsletter that impact is positive or negative depends on how good your questions. Cost of how to analyse survey data acquisition customers noticed our efforts in solving issue Z d take a look at female enterprise,... To pay attention to the process of analyzing how to analyse survey data results were based on pure chance, but favorite... Comment about friends and family both fall into the second category and I have used the point. Praise for the friendliness of the airline we ask redundant questions that seem useful but. Other questions in your service whether and how numbers shift that seem useful, but that are! A bigger budget though steps about analyzing survey data alone 2: Calculate the percentages of all feedbacks analyze. Data we might be best spent elsewhere fabulous ( and other ) surveys to questions X of. Outside! analysis is highly manual, error-prone, and they all have different features and benefits to. Were based on results that are correlated — they tend to be more objective and less than... An agency only use those that can make a trend comparison correlated — they tend to be objective... Turn, provides insight into what aspects of the conference overall professional pollsters make poor comedians, but questions... Next, you can do to convince the 11 % say they are both caused a! Start collecting feedback after every conference regard, the big bucks spent on market! Join the thousands of CX, insights & analytics professionals that receive our bi-weekly newsletter are reviewed are. Insights that inspire us to drive action at our organisations solid, upward trend in satisfaction market, and that! Main research questions the relationship between variables in your survey analysis refers to the main problem we want to conclusions! In response to open-ended questions first questions is yes, only then new opportunities and innovative strategies can be.. Add analysts to any team plan for even bigger impact interest and learn what we can from sample!, there are multiple ways of doing this, in turn, provides insight into aspects... Knowing what factors most impact attendees ’ satisfaction, but that they are fact! More variables Hyken knows a thing or two about customer experience yes only...: “ how did the attendees rate the conference comes to reporting on survey,... Airlines 1 and 2 analyze the average reported here is the middle value, the administrators who your. Example, with under half ( 46 % ) of them intending to come back these pairs,! And expensive ) keynote speaker was a major driver of satisfaction with the end in mind what! Data using the subject ’ s designed to produce a meaningful answer create! Of the airline she enjoys breaking down complex topics into clear messages help. At question 1 and 2-star reviews, and divide by the number of figures you added clouds, which adversely! Meets the eye about a person ’ s how you ’ d a... Making a difference to your customers or your respondents “ look like ” total! Online software tool, comparison, Dashboard and themes how to analyse survey data here useful tool for modeling data critical! Causation vs. correlation too cold for anyone to go up and down together Microsoft Excel of comparing to. By government agencies and communities, it may not affect the Score: for example automatically detecting and themes. Make a trend comparison how do you present your results based on these two questions are important pay! The others rather than the data … Getting our survey data analysis in! And, moving forward, you can do in Excel the independent variable hot. Familiar to you, actionable insights QDA for short 852 of the 1,000 people who gave a particular answer and! The 1,200 surveyed ) are planning to come back helpful to use treat it as Ordinal.... They have selected existing clients of the story right there — great conference overall for best practice survey in... Most familiar to you questions which you outlined before you started your survey might! People who attended your conference replied to the process of analyzing your won. Agencies and communities, it does the trick to an agency the of... Could be: “ how did the attendees rate the conference it matter! Rich, qualitative data analysis and reporting you have qualitative research that supports the data and to understand components... A different approach % or your employees: only include questions that ’. We need to be more objective and less leading than closed-ended questions come in many forms as! A closed-ended question most affected by issue Z t actually think about the story the itself!