Shopify ships native A/B testing and AI shopper simulation.
"It's really about helping merchants become more informed, helping them make more bold decisions."
Aaron Glazer, Product Lead at Shopify, reveals two features from Winter '26 Edition that change how merchants test and optimize their stores. Rollouts brings native split testing directly into the admin. SimGym deploys AI agents trained on billions of purchases to find what's broken before real customers do.
Swym - Wishlists, Back in Stock alerts, & more
getswym.com/kurt
Cleverific - Smart order editing for Shopify
cleverific.com
Zipify - Build high-converting sales funnels
zipify.com/KURT
Apply for Shopify Help
ethercycle.com/apply
See Our Results
ethercycle.com/work
Free Newsletter
kurtelster.com
The Unofficial Shopify Podcast is hosted by Kurt Elster and explores the stories behind successful Shopify stores. Get actionable insights, practical strategies, and proven tactics from entrepreneurs who've built thriving ecommerce businesses.
Kurt Elster • 00:00.001
This episode is sponsored in part by Swim. Okay, here's a depressing stat. 70% of shoppers who want your products never actually buy them. They browse, they consider, then they forget. That's revenue walking out the door. Swim Wishless Plus turns browsers into buyers. Customers save products they want, get notified when prices drop, or items restock. You can also engage them in personalized fashion through your marketing or sales outreach. It's like having a personal shopper reminding them to come back and buy from you instead of your competitors. And 45,000 stores already use it, and it only takes five minutes to install. You could try it free today for 14 days. Go to get swim. com slash curt. That's swimwithay. com slash curt. Turn those maybe later into sales today. Get swim. com. Shopify Winner26 edition had it all kinds of wins in it, but two particular features that I want to dive deep on that And one definitely very exciting to me, and the other I have to know more about. Rollouts and SimGem. SimGem, I'm not quite sure what it does. That's okay. We'll find out. Rollouts. I am beyond thrilled for with this. Native A-B testing coming to your Shopify admin. That's what I took away from it, but we're gonna find out if I got it right because We are lucky today. We're going to be picking the brain of Aaron Glazer, product lead at Shopify, who has worked on these features, right? Who knows them and who's going to explain them to us. Aaron Glazer, welcome to the show.
Aaron Glazer • 01:53.040
How are you doing, my friend? I'm good.
Kurt Elster • 01:54.880
Thanks for having me. I am I'm thrilled you're here. Let's start with a an overview here. Well, I assume uh all right, tell me about rollouts. This is native split testing.
Aaron Glazer • 02:06.500
So Rollouts encompasses a few different capabilities for merchants, uh all in one. So one part of it is native split testing. directly built into Shopify, allowing merchants to go in and test changes within their online storefront or within their themes directly. And and roll out multiple versions of the same storefront to merchants and then measure the impact of those changes directly within their Shopify admin.
Kurt Elster • 02:32.580
Mmm, I love it.
Aaron Glazer • 02:34.580
It's bringing amazing capabilities for merchants to make really informed decisions, but like right inside of their core workflow.
Kurt Elster • 02:41.260
I was gonna say, you know, what's the benefit here if you're not familiar with split testing and it's y you have the data. You can now make a much more confident decision. Around something that's very subjective. Web design, an online store. It feels extremely subjective, right? Because it's so design focused. Finally being able to have show both, you know, both versions of something to your customers or more, it sounds like. Um And know with statistical significance, oh, this is the one that performs better. This is the one that does the thing that we want better. That's quite incredible and quite empowering as a business owner. with a website, you know, that that you rely on for these sales. Incredible.
Aaron Glazer • 03:24.360
It's really about helping merchants become more informed, helping them make more bold decisions. And and applying the data behind the scenes and allowing them to take risks and then measure the value of those risks.
Kurt Elster • 03:39.000
The okay, with our split testing, with rollouts. What I have not played with this. I have not seen it. What what is the format that this takes in my store? Am I you know split testing two themes, two sections? Like what is what's it look like?
Aaron Glazer • 03:56.200
So the the the version of uh or the release of rollets that we've launched at Winter Editions allows you to go in and leverage your individual theme and make changes right within an individual theme. And then within that theme, you're able to split tests. So basically test the original version of your theme and any changes you've made to your theme directly out to your buyer audience. All from within the theme editor.
Kurt Elster • 04:24.320
Excellent. And so assuming like this all were is within the theme editor.
Aaron Glazer • 04:29.200
It's all within the theme editor. So now there's rollouts is is on the uh on the admin panel. So you'll be able to access it from within the markets tab in the in the um admin homepage. And then you'll be able to go in there and start creating rollouts. Now, rollouts are more than just split tests. So part of what is being part of what's being uh delivered within the capability of rollouts is split testing. But another part is actually the capability to schedule and change your storefront at specific times. So you'll be able to go in and say at, you know, at a specific time, uh date and time, I want to go and launch this new storefront, or I want to launch this new change, or in the future being able to launch it with catalog changes or other parts of the admin. Schedule them to go live at a certain time and then potentially, you know, stay live forever, or go live and then be turned off, for example, in a in a periodic or a sale.
Kurt Elster • 05:25.820
So if I had, I love this feature, uh extremely useful, very practical. Let's say I have a sale. Typically these sales start at midnight and I've got changes in the theme, like at my homepage, my announcement bar. in featured collections. Things are the content has to change to inform people of the sale. Look, I go to bed early. I am a sleepy baby. I d I'm not getting up at midnight to click publish on a theme. You're telling me I could just do the have rollouts, this feature will just do this for me.
Aaron Glazer • 05:52.740
We're gonna protect your sleep. So you'll be able to go and schedule it. You're gonna sleep very well. Um you'll be able to go in and schedule it, schedule the changes you want to make, and then have them automatically rolled out at the precise time that you select.
Kurt Elster • 06:05.180
Excellent. And then at the end of the sale, it sounds like I can undo it. I could schedule like hey change it change it back, change it to something else
Aaron Glazer • 06:12.460
Exactly. You know, some sales are temporary, so you can go in, for example, schedule a change to your theme that's that's contextual around the sale that you're trying to make, and then have it automatically uh roll back.
Kurt Elster • 06:23.320
A lot of effort goes into these features, a lot of thought, and so y you don't just make them willy nilly. There it has to be a r a reason why we said, you know what, rollouts, this is the thing. Is there uh could you give me a little uh background or context as to why You know, we impl why why do this now?
Aaron Glazer • 06:41.780
You know, the the one of the one of our jobs are to help merchants um sort of across the entire part of their sh their journey. And the, you know, the the example you just gave of of a lot of sales starting at midnight is a really perfect example of sales are complex. Uh merchants are are planning for them in advance. So the opportunity to schedule and plan multiple components of a sale in advance is huge. Now then added to that capability is the ability to go and schedule multiple components of a sale and then potentially even test different Changes to your storefront, be more bold, make decisions and learn from them. Um, is really the set of capabilities that we're bringing natively into the platform.
Kurt Elster • 07:25.320
I I like that the the benefit we have picked here is be more bold. That's very I like that. That's fun. Be more bold. Because it with the confidence of knowing like, oh, this is you know this is what performs better. Ah, you know, now I I can make those those bolder, wilder changes with confidence. What um What metrics do we track here in our split test? Like with a split test, uh, there has to be a goal that it's keeping track of. What are our options here?
Aaron Glazer • 07:56.180
So you'll have a set of capabilities or set of options that are available. It's all built into the native analytics platform that you're used to. So there are specific results pages designed for uh just rollouts and in the future we're gonna be um allowing you to to measure that even more broadly within the analytics homepage that you're used to.
Kurt Elster • 08:15.960
Very cool.
Aaron Glazer • 08:16.520
Roluts is a it's an awesome product. You know it's it's really about Bringing that native capability right into Shopify. It's it's for many merchants, this is gonna be the first time using split testing or being aware of it. And so a lot of the care that we brought into building the product is one where we can not only bring this really amazing capability to merchants, but help merchants learn along the way. And make it really accessible and easy to use, just like the rest of the Shopify platform, so that it can scale with merchants, but also be accessible to those early merchants that are just going and starting and making their first sale.
Kurt Elster • 08:52.220
It's a good point to make, you know, make it accessible, make it easy to use. Because with split testing, right, there's always the uh the specter of uh statistical significance. Like, you know, is my test correct? Is it is it trustworthy? Do we do anything there to assist with with making good decisions in split testing?
Aaron Glazer • 09:11.920
We do. So the concept of statistical dis significance can be a little scary at first. But what we've done is we've tried to create the results pages where you're really presented with statistical significance in a way that makes them more accessible, more understandable. Helps you understand and learn what's happening so that you can make great decisions, learn from it, and then keep iterating. It's all about learning from what you've done, being bold, taking uh risks, and then continuing to iterate on that.
Kurt Elster • 09:40.839
Beautiful. Perfect. Yeah, I'm I'm excited to use it. Like I desperately want to try this and run a split test. When's it going to be available?
Aaron Glazer • 09:49.319
Uh it's available to uh an early access group of merchants. And then it's gonna be rolling out more broadly in the coming weeks.
Kurt Elster • 09:56.180
Excellent. Okay. I am going to keep an eye out for it. I cannot wait to test it. Here's a word from our sponsor, Zippify. December's not over, and neither are your sales opportunities. You just survived Black Friday and Cyber Monday, but are you maximizing every order that's still coming in? One click upsell automatically increases average order value by up to 30% with AI-powered upsells across your entire customer journey. Holiday shoppers are still buying gift cards, last-minute orders, new year prep, make every sale count, launch pre-purchase and post-purchase upsells for every product in one click. Customers see personalized offers and spend more automatically. Unlike other apps, you only pay for results, not views. Takes under two minutes to set up, starts working immediately. Don't let December revenue slip away. Go to zipify. com slash Kurt for your 30-day free trial. That's zi-ipify. com slash K U R T. Finish the year strong, my friend. Once I've got the data, and once it says, hey, you've your your test is concluded or like you we've reached a statistical significance on which one is better, how how difficult or easy is it to do to roll out those changes?
Aaron Glazer • 11:14.920
So that's one of the beautiful things about it being built right into Shopify natively. We're building the capability so that as you're taking these risks, as you're trying new things, you're learning from your split tests. You're able to see the results and then if you like the results, merge them natively right back into the the the place where you made the changes in the first place. So you're able to just move really quickly, learn, keep evolving, and and grow.
Kurt Elster • 11:43.100
I need this. I do. I need this. I I love split testing. Just the idea that now it is a native feature. You have no idea. It is made by day. Truly. Okay. Simgem. Not not a gym for our Sims. What is it?
Aaron Glazer • 12:03.080
So SimGym is a new app and we're releasing it as an AI research preview. It's being launched as part of Winter Editions. And it's a really unique application of AI. And our our whole winter editions, the theme is Renaissance, Ren AI Sans. And so SimGym is right along the lines of that. And we're we're using AI. To help train AI agents to have human-like profiles that are able to simulate shopper behavior on your storefront. That are reflective of actual shoppers that you might get to your storefront. Obviously, humans are never going to be fully replicated by machines. So what this does is it simulates some of the feedback that you would get from humans based on your storefront. And you're able to conduct similar sorts of simulations of one theme versus another theme and see what your human-like agents Might provide feedback. All in the same vein as of actually running split tests to help you understand and learn and grow and and be bold.
Kurt Elster • 13:09.400
So this is like user testing, except an AI agent does it, and then it at the end it gives me actionable insights?
Aaron Glazer • 13:16.959
Yeah, it's it's not fully testing because testing is is is very much around the quantitative data of human buyers, but what it does is it simulates um some of those results. And it tries to get you some of the learnings that you would get through human uh split testing.
Kurt Elster • 13:32.779
Interesting. I gotta play with this.
Aaron Glazer • 13:35.640
Yeah, and the the amazing part about it is, you know, as a brand, every um every twenty-six seconds An entrepreneur makes their first sale on Shopify. So as we're building these products, we're also thinking about there's an every 26 seconds, there's a new merchant that just had their first sale. And how can we help them grow and learn and ship changes with the confidence of a high-traffic brand? But, you know, maybe they they're just starting out or they're early on their journey as an entrepreneur. So what we're able to do with SimGym is provide them some of that background, some of that information that they wouldn't otherwise get, develop those learnings or help them develop the learnings through simulations that are run in SimGym. And then they can take that forward and and continue growing even faster.
Kurt Elster • 14:17.860
Are these complementary products like the reality of split testing is it it requires quite a bit of traffic. to reach that statistical significance. And if I don't have a ton, it could be, you know, I'm running this test forever. It feels like it could be frustrating. And so SimGim, like this complimentary product, to get me those insights. And then later I move to using a tool like rollouts once I have experienced, you know, confidence, et cetera.
Aaron Glazer • 14:42.340
Yeah, depending if if you don't have a lot of traffic, like a scenario like that. That's where something we're able to go and simulate within SimGim is is absolutely like hugely beneficial.
Kurt Elster • 14:53.040
So what if it my AI shoppers? Uh do we call them sims? Probably not. My sim my my AI shoppers, what are they actually doing? Like click scrolling purchasing?
Aaron Glazer • 15:03.400
They're they're they're going and using uh your store. They're they're they're they're trying to replicate sort of the the broad swath of how your uh your buyers or your shoppers use your storefront. And so they're we're trying to simulate, um, you know, it's it's really about simulation as opposed to like really testing, but we're trying to simulate what those shoppers will do on your storefront to provide you data and learnings. And even understand the feedback as shoppers go and use your store or AI shoppers go and use your store.
Kurt Elster • 15:33.840
And then what's the so what's that like what what's the output? of this thing look like. Give me, you know, I haven't I've not played with it yet. Um but what's that what format does that take? You know, like a report of actionable insights? I'm guessing. You tell me.
Aaron Glazer • 15:50.140
Yeah, it's a report of actionable insights, feedback from the different uh AI shoppers during the simulation, and and real learnings that you're getting from it based on what they saw between uh two different themes that you might be trying out within simulators.
Kurt Elster • 16:05.240
Oh, and wait, it'll do comparisons.
Aaron Glazer • 16:07.720
So it'll be it'll it'll allow you to compare the two different themes. So you can basically go in and give it your current storefront and say, hey, I'm working on this new idea. Um maybe it's a new product detail page or a new home page and test those two different uh changes, two those two different storefronts. as a simulation. And then as it runs, it'll deploy agents. It'll train them, deploy them on your storefront, uh, use those two different themes, and then give you a report back on what was the difference. What did the agents find or not find? What are the learnings and the actionable actionable takeaways you can have from it?
Kurt Elster • 16:42.940
Give me an example.
Aaron Glazer • 16:46.780
Um running on some of my my own uh Stores. I've seen some feedback from agents where it found it difficult to find certain products in some cases.
Kurt Elster • 16:57.680
Oh, so that's like a task it might attempt, like I'm gonna go try and look for a particular product?
Aaron Glazer • 17:02.860
In some cases it might try to do that, but it it might find it difficult to navigate through uh my storefront. It might provide me feedback in one version versus another. So for example, if it is a storefront that has a many l uh like a large uh list of products in a collection, um, it might provide feedback that it's really hard to page through that list. And adding a filter might uh might be beneficial so that you can quickly filter products.
Kurt Elster • 17:29.580
Okay, I know I was excited about rollouts before. Now I want to play with this one now. This is the thing I need to play with. I need to try this.
Aaron Glazer • 17:38.340
They both have their own uh their own set of uses. You know, Rolits is really around helping you schedule and change and then and also run split tests. and do that and and bring it out to humans and and add it out externally to the world. Whereas SimGem is is is really about helping you learn and understand and do it very quickly and iteratively.
Kurt Elster • 18:00.600
It's just the idea that Sim Jim could give me these yeah, could test these scenarios and then give me actionable insights off them. Really quite incredible. I'm very interested in that. Like we've seen similar but less actionable, like less direct versions of this. Like I could I could take a heat I could screenshot a heat map and I can hand it to an AI that I've attempted to explain best practice to. And then, you know, it's gonna come back with like, if I'm lucky, half of that sugg those suggestions are are decent. This case sounds, you know, much more purpose driven, much better trained, like better fit to the scenario. So I'm imagining it gets better results. Are our sim our s simulated shoppers, our AI shoppers. Are they are they looking at screenshots of the site, or is this more like an agent actively navigating a site, or am I going too deep in the weeds?
Aaron Glazer • 18:54.440
No, no, it's it's an agent actively navigating the site. Oh wow. And you know, we're we're able to build these agents using the the information that we have at Shopify, having the benefit of seeing billions of purchases every year. So these personas can start bringing some of that behavior forwards. And then as they're navigating the site, can start replicating some of that information and allow us to tune the models and tune the agents in a way that provides that actional f actionable feedback that's also tuned for the individual store that's being uh being used in the simulator.
Kurt Elster • 19:29.020
Okay. That was gonna be an another thing I was wondering, is there like a single agent shopper that does all this work? Uh do they have personas? Do I have any input as the the merchant into these agents?
Aaron Glazer • 19:43.039
Yeah, you don't have any input, but they end up it it ends up operating as sort of teams of agents. That can go in with different profiles. Again, it representative of the variety of shoppers that you actually have that are using your storefront to provide that holistic feedback as much as we can.
Kurt Elster • 20:01.960
Man, that's really cool.
Aaron Glazer • 20:03.480
Yeah, we're you know we're we're super excited. We're launching it as a research preview. Um it is, I think it is It's one of the first products of this kind, if not the first, that that is able to provide this kind of information and built on top of the billions of purchases every year. within the platform to provide really interesting and and uh actionable insights.
Kurt Elster • 20:26.820
Here's some customer service emails you don't want to wake up to. I was drunk. This was a gift. But we broke up. Wrong color, wrong size, wrong me. Sound familiar? With Cleverific, you don't have to deal with these anymore. Cleverific gives your customers a self-service portal to edit their own orders. No emails, no back and forth, just simple fixes. Fewer support tickets, faster fulfillment, and happier customers. Peter Manning, New York, slashed their order support request by 99%. you can too. Get 50% off the Cleverific Pro Plan, just $49 a month, exclusively for the unofficial Shopify podcast listeners. Go to Cleverific. com slash unofficial and use promo code Kurt50. Fix the problem before it's a problem. That's cleverific. Yeah, one of my my favorite category of features within Shopify are the ones that leverage Shopify's network effects. Just the fact that it is the platform for e-commerce and for for retail. And so we've got the Shopify as a platform has this incredible in-depth knowledge of shopper behavior. it really very uniquely positioned to be able to build a tool like this, you know, versus anyone else would not have that same data and starting point, couldn't do it realistically to the same level of of fit for uh you know an AI shopping agent. That's very clever. You must be proud of this.
Aaron Glazer • 21:58.260
You know what, we're super excited. But ultimately it's the success of the merchants that are using it that is how we measure uh ultimate success. So we're we can't wait to to start hearing the different stories from merchants that are using it, but Um it is, you know, one of the amazing things that exists right now is that the AI gives merchants this this ability to be more creative, more innovative. um and really focus in on their business and focus in on learning. And so with SimGym, we're we're able to channel some of the the learnings and the overall signal that merchants can get and channel it in in a way that provides really actionable learnings, that gives them understanding of their store that they wouldn't have otherwise been able to do, leveraging, you know, the power of Shopify.
Kurt Elster • 22:45.660
Man, I want to play with both these tools right now. All right. The SimGym is in research preview. How do I how do I get to it?
Aaron Glazer • 22:53.740
So you can you can download the SimGym app from the Shopify app store. And we're slowly letting uh merchants uh if there's a wait list, but because um demand is so high for it. Um but we're slowly letting merchants. Yeah, so we're but we're slowly letting letting merchants in. So best thing to do is download shop the Shopify SimGym app from the App Store.
Kurt Elster • 23:15.760
Okay, yeah, and absolutely we'll link to that in the show notes, or of course just type you know search simgym uh in your Shopify admin, make your life easier. And what's the learning curve on this? Like some tools are are more technical than others.
Aaron Glazer • 23:28.900
This this is designed to be totally non-technical. Um so all that you need to do, all that you need to do with SimGym is is really bring two different versions of a theme. Um, and allow it to go and test out your current theme and something new.
Kurt Elster • 23:46.860
And you know, as far as That's very cool. So we've SimGym, rollouts, you know, both helping us reach the same outcome, better website, more confidence. Excellent. Uh easier to run a business that way. And within our Shopify themes, do I have to be, I would imagine in a I need online store 2. 0, I need sections, I need Is there a partic do I have to have a horizons theme?
Aaron Glazer • 24:13.799
Yeah, you have to be right now you have to be using online store. Have uh themes within your online store to test from.
Kurt Elster • 24:19.519
Well, very straightforward. I would imagine most of us do.
Aaron Glazer • 24:23.840
We've tried to make it as easy to use and accessible as possible so that merchants can just get in there and and start using it and start learning from it.
Kurt Elster • 24:32.520
So, okay, bigger picture, zooming out. It is a safe guess we are going to see more AI tools, utilities like this in Shopify. Are we going to see more testing tools?
Aaron Glazer • 24:47.299
I think we're gonna continue to see an expansion of the capabilities we're bringing out here. I think we're just scratching the surface on what you'll be able to do with the different products that we're bringing out. like rollouts and sim gym and we're gonna keep building on top of that. Um so it's uh it's it's gonna be really exciting in terms of what's available to merchants. When we chat this time next year, I'm sure we're gonna be talking about it a lot more.
Kurt Elster • 25:11.160
Absolutely. I so I and then all right, workflow. I imagine I start with SimGim and then I move to rollout. Like SimGym, you know, knockout easier, more obvious changes. You know, things that we don't we don't necessarily need to test with people to feel confident about. It's like, hey, this butt this link doesn't work. Okay, yes. I don't need to test it to know you know I should fix that link versus something more subjective, more squishy, like, hey, we've got these two different layouts, which one's gonna work better? I would think that that's the kind of thing, you know, where I I would want to test that with real, real humans in rollouts.
Aaron Glazer • 25:48.080
Yeah, it you know it depends partially on your workflow too. Um depends on the amount of traffic you have. Um so you know, as as you were mentioning before, depending on the amount of traffic you have, it can take a really long time or it can be very quick in order to find results from a rollout or from a split test. So depending on your traffic level, that'll define kind of the workflow you take and also the types of changes you want to make. For example, if there's a change you want to make that is something you are a little hesitant about going live with right away, then that's where SimGym comes in handy. You can go and try things, you can be bold, and the Sims will give you feedback.
Kurt Elster • 26:24.620
Man, I wanna uh I want to play with it. I do. It just I yeah, I got several stores where I'm like, there's just there's w wacky stuff I would love to run past this and see, you know, what kind of what it gives me. Or just, you know, on the existing stores, like, hey, you know, everyone wants that that edge, you know, that a little bit extra conversion rate, a little higher average order value. Those things really they those make huge differences in these small businesses. And so that's all like that's why I get so excited about these tools.
Aaron Glazer • 26:53.460
For sure. And you know, for for businesses that are scaling and growing, those extra points on conversion rate really matter. For those merchants that are just starting out. Just getting the flywheel moving, helping to give the confidence are really some of the superpowers that you get from this. And sidekick, honestly. Where you're able to get those superpowers from Sidekick to be able to have almost like this extra co-founder with you as an entrepreneur starting out to help you nudge you along the way, help you evolve your storefront and your entrepreneurial journey.
Kurt Elster • 27:23.760
Psychic's really grown on me this year. I use that little guy for I have I'm able to generate reports pretty easily that previously like would either take me time of fiddling to make the report myself Or I just, you know, I I probably wouldn't necessarily bother. Or I'd you'd you know, whereas with psychic I could just I just ask the question. Or I say I task it. I say, Hey Jake, could you generate me a report, you know, with these uh these filters are parameters. And it's you know, of course, it's very helpful. So yeah, happy too. I love it. No, it saved me quite a lot of time.
Aaron Glazer • 27:56.800
Yeah, it's amazing. It's it's unbelievable sort of when you go from having to think about how do I do this type of analysis to just saying, hey, I'd really love to know the answer to this question. And then leave it to sidekick to figure out how you develop the answer to that question or how you go and do something. It's it's an amazing transformation. I think it allows the merchant to think a little bit bigger picture in as opposed to, you know, like what is the exact thing I need to do on this screen to get the analysis done. It's really, you know, how are my sales um this week? Yes, what what products sold more? Was there anything that was selling uh differently than the previous week?
Kurt Elster • 28:33.680
Well, you know, people present me with very difficult questions. They're like, well, you know, our conversion rate changed one way or another during this period and you know Why? You know, help. And I can ask I could turn around and ask Sidekick or go, hey, you know, can you break down for this this period? uh converged rate by channel and help me understand. And like you can work step by step and think through with it. Like as long as you know you're leading it, you get a very good result. Um yeah, I like it a lot. Yeah, we're supposed to be talking about rollouts and and uh and sim jam, but I would imagine that you know with I could st If I have these tools plugged in at some point, I'm gonna be able to say, or I have these apps installed, these features enable, I'm gonna be able to ask Sidekick for assistance with these things.
Aaron Glazer • 29:17.280
Yeah, that's that's definitely uh in the future uh something that's coming. I I mean I love Sidekick as well. It's an amazing tool and it's only gonna get more powerful.
Kurt Elster • 29:26.480
You know, we've got listeners there also hopefully excited about this. What's one test they should run?
Aaron Glazer • 29:33.360
The the one piece of advice I would give is that think um Think big picture. So look at your buyer funnel in terms of where your drop-offs are. Typically you'll have like a really big drop-off on your landing page. Um, could be your bounce rate. So I would suggest start testing on the the parts of your your storefront that have the largest amount of traffic and then go piece by piece down there. As opposed to trying to test something that is rarely seen or a really small uh part of the funnel, which can be a very critical piece of the funnel, but the traffic is lower. So it takes a lot longer to learn from it. So I'd say if you're just starting out on your journey, Start big picture. Try the hero banner on your homepage, for example.
Kurt Elster • 30:14.040
Uh yep excellent advice. I agree. The I have found consistently bigger changes lead to you know faster conclusive results and tests. Yeah. I think the classic split test is I was like, well, what button color? Well it turns out that actually that's a very difficult test to run because it's it's uh too small and finite It's subjective a change, whereas you know, much bigger changes. You know, being bold, as you've said, that's you know, where you really uh have much better results with split testing. It's like, let's try two very different things. in different directions and see which which our customers prefer, what resonates, what works better. Uh the okay. Any Any any mistakes, any any gotchas people should avoid going into this Nothing uh offhand.
Aaron Glazer • 31:03.260
I think you know we've tried to really make these products to be as accessible to use as possible. Um so if there are, then I I want to know about it because we've We've made a mistake on our end, but we'd love to hear the feedback from merchants who are going in and using it.
Kurt Elster • 31:17.460
All right, tell me how I get started. Where do I go? What do I do?
Aaron Glazer • 31:21.160
Yeah, just go into your Shopify admin, click on markets in the the left bar, the left nav bar, and then click roll it and then create a new roll it and get started.
Kurt Elster • 31:31.040
Man, I'm I'm I'm gonna try it right now. I will attempt it. Uh Aaron Glazer, product lead at Shopify. Thank you so much. I am so excited.
Aaron Glazer • 31:41.120
Thanks so much. Thanks for having me.
Kurt Elster • 31:44.040
Hey, before you go, I was hoping you would check out our new app, Promo Party Pro. It is what I want to be the single best, easiest way to run a free gift with purchase promo on Shopify. We just put it live in the App Store. We've got less than 50 users. We want your feedback. So if you need to run a free gift with Purchase Promo in the near future, install it, try it. There's a live chat. I check that all the time. And so if you have any issues at all, you know, or any suggestions on how we can make it even easier to use, let us know. We're happy to help. If you want to try it, search promo party in the app store. Promo PartyPro is the app. Give it a shot. It's got a free trial. Thanks