Related Posts
Hey, Fishies! We’re launching our first Interview/Q+A series "Portfolio Rewind: Would You Hire You?"
Like a portfolio review in reverse, creative leaders will share work they created when they first started out and critique it as if were a book that had just landed in their inbox. Then, tell us if they’d hire their younger selves knowing, and expecting, what they do now.
Drop in for get the chance to ask questions, and get your book reviewed by our guest. Hope you can make it!
zoom.us/j/92635977143
Join us for our first virtual panel on Tonight, Wednesday May 20th at 5 PM EST, Navigating the Ad Industry When the Economy Sucks. Tom Christmann & Paul Fix, award-winning ad creatives and co-deans at Adhouse, will be joining us and taking questions.
https://zoom.us/j/94553752267
More info and calendar links in comments.
More Posts
Hi, anyone here working in Lululemon Bangalore?
Additional Posts in Product Management
Places to post and get user feedback?/surveys?
How hands-on are you in scrum meetings?
New to Fishbowl?
unlock all discussions on Fishbowl.





What were the goals for it?
The goal was to drive higher adoption of the overall product, we were trying to see if ease of use through a search like feature in a group chat would be impactful to drive higher engagement.
Client retention just enough - would not kill but would wait to ship.
Depends on the main metric that this was trying to measure or improve on
Retention isn’t significant to drive a large impact so probably not, as M1 stated above but if it was to improve number of messages sent or smth then yes
"retention not significant enough to drive a large impact"? Do you think it's an unsustainable result? (The p value is quite small though)
Need more context - from first glance I don't 100% follow but it depends on the situation. I'm sure I'm missing something
Coach
Why is your # of days of client retention metric so short? Is this chat feature a key part of the user workflow? Hard to make a recommendation based on the limited info here. You prob want to look at how much users are engaging with other adjacent elements of the UI. Determine if they’re ignoring your piece of the product as a whole or just the search feature. If they’re ignoring your product in general, you’re going to need to do something bigger and more innovative to hook users in
Adding more context; the feature was to enable a search functionality in a group chat so that users can reach to particular messages easily
Prioritization of feature - a search functionality that enables a user to search different chat rooms vs a search functionality that enables a user to search within messages of a chat room. (Based on the Goal to drive higher engagement wouldn't the success metric be client retention?)
Aren’t most p-values insignificant? To me it makes sense to continue the pilot for a bit. I’d like to see retention, engagement develop a bit more
Isn't the "significance" defined by the user group and maturity of the product? Imo If there's a larger user base 0.15% is high enough to ignore the metric.
I enjoy the question but the data is from 2014 so what is this test?
Visual Storyteller
That's true, it's a hypothetical situation. I am trying to learn ☺️
I would want to see more adoption and retention, continue the pilot until that goes up.
Visual Storyteller
Are you suggestion to continue the pilot without any major tweaks?