1. Analysis Setup
Project / Study name
Q2 onboarding survey review for AcmeOps analytics workspace
Research objective
Identify what helps or blocks new admins from reaching first value within the first 14 days after signup.
Survey source
In-app NPS follow-up and open-text onboarding survey sent to trial users after workspace setup completion.
Response volume analyzed
187 total responses reviewed; 162 usable open-text comments after removing blanks and duplicates.
Audience segment
New B2B SaaS customers: operations managers, RevOps leads, and admin users from companies with 50–500 employees.
Key survey questions
“What almost stopped you from getting value?” “What was easiest?” “What felt confusing or missing?”
Unit of analysis
One response can receive multiple codes when it mentions more than one distinct idea.
Coding rule
Code only explicit statements in the text; use a secondary note when sentiment is implied but not directly stated.
Analyst notes before coding
Watch for repeated friction around CSV import, Salesforce sync, dashboard setup, and unclear permissions language.
Tip: Before coding, skim 20–30 responses first and confirm your code list matches the language people actually use in the survey.
2. Coding Guide
Time-to-value clarity — Comments about whether users quickly understood how to get to a meaningful outcome after signup. Example: "I created the workspace, but I still wasn't sure what the first useful report was supposed to be."
Data import friction — Mentions of trouble uploading CSVs, mapping fields, or cleaning source data before the product becomes usable. Example: "The CSV importer rejected two columns and didn't explain what format it wanted."
Integration setup confusion — Feedback about connecting external systems such as Salesforce, HubSpot, or Slack and not understanding required steps or permissions. Example: "The Salesforce sync looked straightforward until I hit the permissions page and had no idea what to grant."
Dashboard customization limits — Responses saying the default dashboards are useful but too rigid, or that key filters, widgets, or saved views are missing. Example: "The pipeline dashboard is nice, but I can't break it down by region without rebuilding everything from scratch."
Permissions and team access uncertainty — Statements about not knowing who can see, edit, or share reports, dashboards, or workspaces. Example: "I didn't want to invite the sales managers until I knew whether they could accidentally change the master dashboard."
Terminology mismatch — Cases where product labels, feature names, or setup language do not match how customers describe their workflow. Example: "We call these territories, not segments, so I kept second-guessing whether I was in the right place."
Support and documentation effectiveness — Mentions of help center articles, onboarding emails, chat support, or walkthroughs either resolving or failing to resolve a problem. Example: "The setup article existed, but it skipped the exact admin step I got stuck on."
Evidence of product value — Specific moments where a user describes the product proving its usefulness through saved time, clearer reporting, or stakeholder visibility. Example: "Once the weekly churn dashboard populated, I finally had something I could share with leadership immediately."
Tip: Keep codes narrow enough that two analysts would tag the same response similarly, but broad enough to capture repeated patterns across dozens of comments.
3. Theme Log
Theme: Data import friction · 41 mentions
Many new admins hit avoidable friction in the CSV Importer when mapping custom fields and date formats, delaying first analysis by hours or days. Top quote: "I had our pipeline export ready, but the importer kept flagging close_date and owner_id without telling me what valid formatting looked like." → Recommended action: add inline field-format examples, show row-level validation errors, and provide a one-click sample CSV for common CRM exports.
Theme: Integration setup confusion · 33 mentions
The Salesforce and HubSpot connectors create momentum at first, but permission scopes and sync-status messaging cause drop-off before users trust the data. Top quote: "The Salesforce connection said 'connected,' but nothing was pulling in, and I couldn't tell if it was still syncing or if I broke it." → Recommended action: redesign connector onboarding with clearer permission instructions, estimated sync time, and a visible troubleshooting checklist inside the setup flow.
Theme: Dashboard customization limits · 27 mentions
Users appreciate the default Executive Overview dashboard, but power users quickly want region filters, custom formulas, and reusable widget layouts that are not obvious or not available. Top quote: "The Executive Overview got me 80% there, but the minute my VP asked for EMEA-only conversion rates, I had to duplicate the whole dashboard and hack around it." → Recommended action: prioritize segment-level filters, easier widget duplication, and a 'save as team template' option for common dashboard variants.
Theme: Permissions and team access uncertainty · 22 mentions
Admins hesitate to invite collaborators because report editing rights, viewer access, and workspace-level permissions are not easy to understand during setup. Top quote: "I held off inviting our CS lead because I couldn't tell whether 'editor' meant they could edit just their view or change the company dashboard for everyone." → Recommended action: simplify role labels, add plain-language permission previews, and show exactly what each role can do before invites are sent.
Theme: Evidence of product value · 19 mentions
When users reach a live dashboard with their own data, they describe a sharp jump in confidence and are more likely to mention sharing insights with leadership or their GTM team. Top quote: "The first time the Weekly Pipeline Health board populated with our actual stages, I screenshotted it and sent it straight to our CRO." → Recommended action: accelerate users toward a populated first dashboard by auto-generating a recommended view immediately after import or sync completion.
Tip: A good theme card captures three things in one place: what happened repeatedly, evidence from a verbatim quote, and what the team should do next.
4. Pattern Checks and Interpretation Notes
Segment differences observed
Operations managers mentioned CSV import friction more often, while RevOps leads more frequently raised concerns about Salesforce permission scopes and sync reliability.
Responses with multiple themes
A common pairing was integration setup confusion + time-to-value clarity, suggesting users do not just struggle with setup—they also lose sight of the payoff while blocked.
Outliers worth reviewing separately
A small number of enterprise respondents requested audit logs, SSO mapping, and sandbox environments; these are important but should not be merged into core onboarding themes for SMB and mid-market trials.
Potential bias or limitations
This sample overrepresents users who finished initial setup and chose to answer an in-app survey, so the analysis may understate problems faced by users who dropped before activation.
Questions for follow-up research
Should we run 5 moderated onboarding sessions focused on Salesforce connection setup, and should we compare import completion rates by template type?
Tip: Add interpretation only after coding is complete; otherwise, early assumptions can bias which themes you notice most often.
5. Summary Findings
Top 3 themes by volume
1) Data import friction (41 mentions), 2) Integration setup confusion (33 mentions), 3) Dashboard customization limits (27 mentions)
Most urgent action
Improve the CSV Importer experience first, because it is the largest onboarding blocker and directly delays users from reaching a populated dashboard.
Metric to track
Activation rate to first populated dashboard within 7 days, plus CSV import completion rate and connector setup completion rate by source.
Key takeaway for stakeholders
Users believe the product can deliver clear reporting value, but setup friction in imports, integrations, and permissions prevents that value from being realized consistently.
Priority actions for next sprint
Ship importer validation improvements, add connector progress states, and rewrite permission labels with clearer role descriptions.
Share with
Product manager, onboarding squad, design lead, lifecycle marketing, customer success leadership, and sales engineering.
Stakeholder notes
Engineering should review whether current import errors can be surfaced client-side; Customer Success should align setup documentation with the top friction points found here; Marketing can reuse value-proof quotes in onboarding messaging once setup blockers are reduced.
Tip: End with decisions, not just observations—your summary should make it obvious what the team should fix, who needs the findings, and how success will be measured.