<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>Elephants and Analytics &#187; behavioural targeting</title>
	<atom:link href="http://www.elephantsandanalytics.com.au/blogposts/tag/behavioural-targeting/feed/" rel="self" type="application/rss+xml" />
	<link>http://www.elephantsandanalytics.com.au</link>
	<description>&#34;Elephant in the corner&#34; is an English idiom for an obvious truth that is being ignored or goes unaddressed.</description>
	<lastBuildDate>Mon, 05 Dec 2011 11:02:09 +0000</lastBuildDate>
	<language>en</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.org/?v=3.2.1</generator>
		<item>
		<title>Hello 15!</title>
		<link>http://www.elephantsandanalytics.com.au/blogposts/hello-15/</link>
		<comments>http://www.elephantsandanalytics.com.au/blogposts/hello-15/#comments</comments>
		<pubDate>Sun, 07 Aug 2011 15:11:40 +0000</pubDate>
		<dc:creator>Tim Elleston</dc:creator>
				<category><![CDATA[SiteCatalyst]]></category>
		<category><![CDATA[behavioural targeting]]></category>
		<category><![CDATA[calendar]]></category>
		<category><![CDATA[campaigns]]></category>
		<category><![CDATA[Conversions]]></category>
		<category><![CDATA[evars]]></category>
		<category><![CDATA[full sub relations]]></category>
		<category><![CDATA[key metrics]]></category>
		<category><![CDATA[normalisation]]></category>
		<category><![CDATA[normalization]]></category>
		<category><![CDATA[page views]]></category>
		<category><![CDATA[props]]></category>
		<category><![CDATA[Segmentation]]></category>
		<category><![CDATA[segments]]></category>
		<category><![CDATA[site overview]]></category>
		<category><![CDATA[visitors]]></category>
		<category><![CDATA[visits]]></category>

		<guid isPermaLink="false">http://www.elephantsandanalytics.com.au/?p=692</guid>
		<description><![CDATA[<a href="http://www.elephantsandanalytics.com.au/blogposts/hello-15/"><img align="left" hspace="5" width="75" height="75" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/08/default_segments-150x150.png" class="alignleft wp-post-image tfe" alt="default_segments" title="default_segments" /></a>Well, it’s August and true to their word, Adobe upgraded us to SiteCatalyst v15 on the 1st, and so I thought I’d share a few of the golden nuggets within v15.

I was thinking about how to order them…do I go by not bad to flamin’ eck, that’s awesome? Or start with the big bang and then let it continue to smoulder throughout?  

The problem is there are too many new and great features that you can’t really put them in any type of order.  They appeal to you on different levels, from functionality, to UI, to analysis, to reporting, to combination segmentation and sub reporting.

]]></description>
			<content:encoded><![CDATA[<div class="tweetmeme_button" style="float: right; margin-left: 10px;">
			<a href="http://api.tweetmeme.com/share?url=http%3A%2F%2Fwww.elephantsandanalytics.com.au%2Fblogposts%2Fhello-15%2F"><br />
				<img src="http://api.tweetmeme.com/imagebutton.gif?url=http%3A%2F%2Fwww.elephantsandanalytics.com.au%2Fblogposts%2Fhello-15%2F&amp;source=timelleston&amp;style=normal&amp;b=2" height="61" width="50" /><br />
			</a>
		</div>
<p>Well, it’s August and true to their word, Adobe upgraded us to SiteCatalyst v15 on the 1st, and so I thought I’d share a few of the golden nuggets within v15.</p>
<p>I was thinking about how to order them…do I go by not bad to flamin’ eck, that’s awesome? Or start with the big bang and then let it continue to smoulder throughout?&#160; </p>
<p>The problem is there are too many new and great features that you can’t really put them in any type of order.&#160; They appeal to you on different levels, from functionality, to UI, to analysis, to reporting, to combination segmentation and sub reporting.</p>
<p>And as this post is kind of huge (sorry you might a coffee and a bagel on this one), here’s a little taste of what’s covered in it:</p>
<ul>
<li>&#160;<a href="#segment">Segment, the all powerful segmentation</a> </li>
<li>&#160;<a href="#newsegments">New segments </a></li>
<li>&#160;<a href="#siteoverview">Site Overview Report </a></li>
<li>&#160;<a href="#segmentedoverview">Segmented Overview Report </a></li>
<li>&#160;<a href="#sidebyside">Side by Side segments (well sort of)</a> </li>
<li>&#160;<a href="#keymetrics">Key Metrics report </a></li>
<li>&#160;<a href="#normalization">Normalization (one of my new best friends) </a></li>
<li>&#160;<a href="#vvpv">Visits, Visitors and PageViews </a></li>
<li>&#160;<a href="#fullsubs">Full Sub Relations – multiple breakdowns on eVars </a></li>
<li>&#160;<a href="#trafficbreakdowns">Traffic prop breakdowns </a></li>
<li>&#160;<a href="#user">Login as another user </a></li>
<li>&#160;<a href="#calendar">Calendar events specific to report suites </a></li>
<li>&#160;<a href="#changes">Significant changes</a> </li>
</ul>
<p>So let’s start with the big one that everyone knows about, or at least should.</p>
<p> <a name="segment"></a><br />
<h3>Segments</h3>
<p>Unless you’ve been living under a rock for the last 5 months, you’ll have heard about the segmentation capability within SiteCatalyst v15.</p>
<p><img style="background-image: none; border-right-width: 0px; padding-left: 0px; padding-right: 0px; display: inline; float: right; border-top-width: 0px; border-bottom-width: 0px; border-left-width: 0px; padding-top: 0px" title="default_segments" border="0" alt="default_segments" align="right" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/08/default_segments.png" width="248" height="272" />Out of the box, it comes with 7 pre-defined segments that are shared across SiteCatalyst, Discover, and Test&amp;Target. </p>
<p>These segments were chosen because, according to Ben Gaines at Adobe, they are “valid (and important!) for all of our users—across vertical and market size. We’ve also seen these types of segments predict different behavior across a variety of actions: registration flows, purchases, and general site browsing.”</p>
<p> <a name="newsegments"></a><br />
<h3>New Segments</h3>
<p>You can, of course, create your own segments on the fly and apply them to any report as well.&#160; If you’re a Discover user, you can create them in Discover and save them back into SiteCatalyst for later use.</p>
<p>I’ve not yet figured out how to create a segment available across all report suites, without creating it in Discover.&#160; Perhaps Adobe can help on this one?</p>
<p>Segments can also be used in Test&amp;Target too. There’s a one-click little target icon next to the segment box which opens up a new A/B..n campaign in Test&amp;Target, although it doesn’t specifically target custom segments that you’ve created as that’s a little more complex – but the preconfigured ones are available for use immediately.</p>
<p> <a name="siteoverview"></a><br />
<h3>Site Overview report</h3>
<p>This new report is actually a dashboard, but, it’s highly useful and can be modified to your needs.&#160; Using the same features as dashboards, you can set this one to your landing page when you log in (no more pinwheel).</p>
<p><img style="background-image: none; border-right-width: 0px; padding-left: 0px; padding-right: 0px; display: inline; border-top-width: 0px; border-bottom-width: 0px; border-left-width: 0px; padding-top: 0px" title="site_overview" border="0" alt="site_overview" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/08/site_overview.png" width="644" height="468" /></p>
<p>From those reportlets, you can get to the main report by clicking on the name of the reportlet.</p>
<p>You can also change the date and the whole thing will rerun against the new dates.</p>
<p> <a name="segmentedoverview"></a><br />
<h3>Segmented Overview</h3>
<p>If you want to see a particular reportlet using a specific segment without running the whole dashboard again, just click on the report suite name within the reportlet and a little popdown appears, allowing you to select not only the report suite, but also a segment to use.</p>
<p>When you select a new segment, it will re-run the reportlet, not the dashboard, against the new segment.</p>
<p><img style="background-image: none; border-right-width: 0px; padding-left: 0px; padding-right: 0px; display: inline; border-top-width: 0px; border-bottom-width: 0px; border-left-width: 0px; padding-top: 0px" title="reportlet_segment" border="0" alt="reportlet_segment" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/08/reportlet_segment.png" width="204" height="244" /></p>
<p>&#160;</p>
<p>Of course if you want to run the entire dashboard against the new segment, then just select the segment in the main segment dropdown and you’ll get instant gratification.</p>
<p> <a name="sidebyside"></a><br />
<h3>Side by Side Segments</h3>
<p>Ok, so you still need Discover to do comparative segmentation, but, there is a sneaky little way to show two segments at the same time, using a dashboard report.&#160; Generate your base report, for example, I’ve used calculated metrics on the new Key Metrics report (see below for more info).</p>
<p>Then apply a segment, and add it to a dashboard.&#160; Apply another segment and add it to the same dashboard.</p>
<p>Then go to the dashboard layout editor (which is also new), and just put both reportlets into the new dashboard.</p>
<p><img style="background-image: none; border-right-width: 0px; padding-left: 0px; padding-right: 0px; display: inline; border-top-width: 0px; border-bottom-width: 0px; border-left-width: 0px; padding-top: 0px" title="segment_compare" border="0" alt="segment_compare" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/08/segment_compare.png" width="644" height="393" /></p>
<p>What you get is a visualisation of the two (or more) segments, plotted over time.</p>
<p> <a name="keymetrics"></a><br />
<h3>Key metrics report</h3>
<p>One of my personal new favourites here is the Key Metrics report, which allows you to put multiple metrics on a time-based report.&#160; This was always one of the big challenges before, but, they listened to us, and here it is.&#160; And there’s a bunch of nifty things about this report that I just love!</p>
<p>Firstly, as shown above, you can add multiple metrics, or calculated metrics to the report – something you could never do before.&#160; For instance, you can add Visitors, Visits, Page Views, Conversion Metrics, Conversion Rates and so on.</p>
<p><img style="background-image: none; border-right-width: 0px; padding-left: 0px; padding-right: 0px; display: inline; border-top-width: 0px; border-bottom-width: 0px; border-left-width: 0px; padding-top: 0px" title="key_metrics_multi_metrics" border="0" alt="key_metrics_multi_metrics" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/08/key_metrics_multi_metrics.png" width="644" height="359" /></p>
<p>Now that you’ve got the key metrics trended side by side, every worthy analysis ninja will look to segment that information – so, just go ahead and apply those segments.</p>
<p>One of the great things about this report is you can do calculated metrics too…side by side (see the image for side by side segments above).</p>
<p> <a name="normalization"></a><br />
<h3>Normalization</h3>
<p>Ah, what a great idea this was.&#160; Normalize your data on the Key Metrics Report.&#160; As you can see from the above screen shot, the page views data is overwhelming the trending report, making it difficult to view some of the trends for the other metrics.</p>
<p>But that’s ok now – just normalize it.&#160; Same report as above, just normalized.&#160; And the other metrics pop up.</p>
<p><img style="background-image: none; border-bottom: 0px; border-left: 0px; padding-left: 0px; padding-right: 0px; display: inline; border-top: 0px; border-right: 0px; padding-top: 0px" title="normalized_key_metrics" border="0" alt="normalized_key_metrics" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/08/normalized_key_metrics1.png" width="644" height="316" /></p>
<p>Ok, so those metrics that I’ve used don’t really tell us anything.&#160; How about this one then?</p>
<p><img style="background-image: none; border-bottom: 0px; border-left: 0px; padding-left: 0px; padding-right: 0px; display: inline; border-top: 0px; border-right: 0px; padding-top: 0px" title="normalized_key_metrics_insights" border="0" alt="normalized_key_metrics_insights" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/08/normalized_key_metrics_insights1.png" width="644" height="297" /></p>
<p>I’ve highlighted dates when certain metrics weren’t in line with the norm.</p>
<p>Now you have something to go and look at.&#160; Why, on those dates, did those metrics “pop”.&#160; What did you do?&#160; Did they vary by segment?&#160; And what can you do to nudge those that didn’t behave similarly?&#160; You can learn from that.</p>
<p>Love this report.&#160; One of my new best friends.</p>
<p> <a name="vvpv"></a><br />
<h3>Visits Visitors &amp; PageViews </h3>
<p>Yes, these are now available across most conversion reports.&#160; You used to be able to get Visits and Visitors by special request, but now, they’re enabled and you get Page Views as well.&#160; And they’re particularly useful across things like campaign reports, referring domains, search engines, keywords etc.</p>
<p> <a name="fullsubs"></a><br />
<h3>Full Sub Relations – multiple breakdowns on eVars</h3>
<p>Remember the days when you had to think carefully about setting up subrelations on eVars…should you use Full or Basic?&#160; And remember the impact if you got it wrong, or realized later that you needed Full Sub Relations on a key eVar?</p>
<p>Well, those days are gone.</p>
<p>You now get full subrelations on all eVars (although I don’t quite understand why the admin asks you still for the type of subrelation you want when you create an eVar – Omniture…can you add any info here?)</p>
<p>In this example, I’ve used two eVars, both are set up in the admin as Basic Subrelations, but I’m able to now break one down by the other, and then I’ve added a filter to remove the keyword “murdoch” from the report.&#160; As you can see, it’s a conversion report, with Unique Visitors, Visits and Page Views, as well as success events.</p>
<p><img style="background-image: none; border-right-width: 0px; padding-left: 0px; padding-right: 0px; display: inline; border-top-width: 0px; border-bottom-width: 0px; border-left-width: 0px; padding-top: 0px" title="user_type_by_organic_search" border="0" alt="user_type_by_organic_search" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/08/user_type_by_organic_search.png" width="644" height="239" /></p>
<p>Once again, you can sub-segment this report against any of your existing (or on-the-fly) segments. Yay!!!</p>
<p> <a name="trafficbreakdowns"></a><br />
<h3>Traffic Prop breakdowns</h3>
<p>Another great feature is the ability to now breakdown key traffic props, such as the referring domain report.&#160; It used to have basically “instances” and allowed you to put in success events.</p>
<p>No more.</p>
<p>Now you can not only see Visits, Visitors and Page Views, as well as success events, but you can also now break it down by things like Average Time on Site, and, all eVars…wow!&#160; Couldn’t do anything like that in v14.</p>
<p><img style="background-image: none; border-bottom: 0px; border-left: 0px; padding-left: 0px; padding-right: 0px; display: inline; border-top: 0px; border-right: 0px; padding-top: 0px" title="referring_domains_time_spent" border="0" alt="referring_domains_time_spent" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/08/referring_domains_time_spent1.png" width="644" height="325" /></p>
<p>And you can flip it too…start with a conversion report, such as our <a href="http://www.elephantsandanalytics.com.au/blogposts/moving-beyond-business-based-segmentation/" target="_blank">Figure Out Your Life segments</a>, and you can break them down, by Referring Domains, or Time Spent per Visit etc.</p>
<p>Ok, long post I know, but, there’s so much going on that I’ll probably add more posts in the future on the new features.</p>
<p>Just to touch on some of the other new things as well…</p>
<p> <a name="user"></a><br />
<h3>Login as another user</h3>
<p>Do you have a user that’s experiencing problems?&#160; Well, now you can log in as that user.&#160; Go to the admin and views the users, then click on “Login as this user”.</p>
<p> <a name="calendar"></a><br />
<h3>Report specific calendar events</h3>
<p>One of the problems with SC14 calendar events was that they showed up across every other report suite…which made it very unhelpful to users that had somewhat restricted views, such as global sites and regional sites.&#160; The UK office didn’t really care that you ran a specific promotion, but they saw it anyway.</p>
<p>Now you can apply a calendar event to a specific report suite only.&#160; To be honest, the link for it is a little tough to spot, so I’ve put a whopping great big arrow to it:</p>
<p><img style="background-image: none; border-bottom: 0px; border-left: 0px; padding-left: 0px; padding-right: 0px; display: inline; border-top: 0px; border-right: 0px; padding-top: 0px" title="calendar_event" border="0" alt="calendar_event" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/08/calendar_event1.png" width="513" height="395" /></p>
<p>&#160;</p>
<p>Ok, now I’ve covered the things that I’m excited about, there are a few things that new users need to understand with this version.</p>
<p>This has all come about because of the way that data is stored.&#160; It used to be pre-processed into the reports, which resulted in the limitation on segmentation and other capabilities such as breakdowns.&#160; But Discover always worked off the original unprocessed data, which also led to some differences in the data, especially around unique visitor counts and classification deduping.</p>
<p>SiteCatalyst v15 now runs off the raw data – the same as Discover, so the datasets are the same, hence the reports are the same.</p>
<p> <a name="changes"></a><br />
<h3>Key Differences</h3>
<p>There are some key differences between v14 and v15 that you need to be aware of:</p>
<blockquote><h4>Visits for Non-Cookied Visitors </h4>
<p>All visitors, regardless of them accepting a cookie are now included in Visit counts and pathing data.&#160; But this increases your Visits metric, so your conversion rates will likely go down a bit.&#160; In testing, the increase of visits was about 0.5% for first-party cookies, and 5-12% for third party cookies.&#160; Another great reason why you should be on first party cookies (contact your account manager if your tracking server has 2o7.net in it).</p>
<h4><strong>Time Spent metric</strong>&#160;</h4>
<p>Both the time spent per visit and the average time spent on page metric now use all server calls to generate the metric, which is much improved on SC14.&#160; What this means is that non-page view data is included in time spent reports, such as custom links etc.&#160; And, they’re no longer bucketed.&#160; It now works off an average for each and every individual page view.</p>
<h4><strong>De-duplicated Visits and Visitors in Classifications</strong>&#160;</h4>
<p>Classifications are now correctly de-duplicated, meaning that when you group things using classifications, they are now de-duplicated, whereas before, they would count each instance of a visit or visitor.</p>
</blockquote>
<p>Ben Gaines wrote an <a href="http://blogs.omniture.com/2011/05/26/15-for-15-improved-metrics-and-logic/" target="_blank">excellent blog post</a> about these and a couple of others which is definitely worth reading and getting to grips with.</p>
<h3>Summary</h3>
<p>What can you say?</p>
<p>Thank you, Omniture Business Unit within Adobe, for listening to us.&#160; These changes make the platform even more useful than it already was and clearly makes it a powerhouse in the web analytics space.</p>
<p>With these, and many other changes made, we’re able to provide our organizations with even more insights that lead to more business optimization capabilities, a better ROI and hopefully more analysis ninjas.</p>
<p>Thanks guys!</p>
]]></content:encoded>
			<wfw:commentRss>http://www.elephantsandanalytics.com.au/blogposts/hello-15/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Visitor Scoring &#8211; the engaged visitor segment</title>
		<link>http://www.elephantsandanalytics.com.au/blogposts/visitor-scoring-the-engaged-visitor-segment/</link>
		<comments>http://www.elephantsandanalytics.com.au/blogposts/visitor-scoring-the-engaged-visitor-segment/#comments</comments>
		<pubDate>Thu, 21 Jul 2011 15:34:42 +0000</pubDate>
		<dc:creator>Tim Elleston</dc:creator>
				<category><![CDATA[Discover]]></category>
		<category><![CDATA[behavioural targeting]]></category>
		<category><![CDATA[campaigns]]></category>
		<category><![CDATA[Conversions]]></category>
		<category><![CDATA[engagement]]></category>
		<category><![CDATA[scoring]]></category>
		<category><![CDATA[Segmentation]]></category>
		<category><![CDATA[site analysis]]></category>
		<category><![CDATA[SiteCatalyst]]></category>
		<category><![CDATA[Strategies]]></category>
		<category><![CDATA[Test&Target]]></category>
		<category><![CDATA[visitor engagement]]></category>
		<category><![CDATA[visitor interaction]]></category>
		<category><![CDATA[visitor scoring]]></category>

		<guid isPermaLink="false">http://www.elephantsandanalytics.com.au/?p=676</guid>
		<description><![CDATA[<a href="http://www.elephantsandanalytics.com.au/blogposts/visitor-scoring-the-engaged-visitor-segment/"><img align="left" hspace="5" width="75" height="75" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/07/engaged_visitor_segment_in_discover_thumb-150x150.png" class="alignleft wp-post-image tfe" alt="engaged_visitor_segment_in_discover" title="engaged_visitor_segment_in_discover" /></a>So I promised that I would finally put fingertip to keyboard and talk a little bit more about using Visitor Scoring…to finish up the series that I started a while ago.

If you’ve read my previous posts, you’ll know that we implemented a series of metrics for engagement measurement, culminating in a per-visitor score.

I wanted to share with you some of the insights and benefits of doing all of this, particularly in Discover.]]></description>
			<content:encoded><![CDATA[<div class="tweetmeme_button" style="float: right; margin-left: 10px;">
			<a href="http://api.tweetmeme.com/share?url=http%3A%2F%2Fwww.elephantsandanalytics.com.au%2Fblogposts%2Fvisitor-scoring-the-engaged-visitor-segment%2F"><br />
				<img src="http://api.tweetmeme.com/imagebutton.gif?url=http%3A%2F%2Fwww.elephantsandanalytics.com.au%2Fblogposts%2Fvisitor-scoring-the-engaged-visitor-segment%2F&amp;source=timelleston&amp;style=normal&amp;b=2" height="61" width="50" /><br />
			</a>
		</div>
<p>So I promised that I would finally put fingertip to keyboard and talk a little bit more about using Visitor Scoring…to finish up the series that I started a while ago.</p>
<p>If you’ve read my <a href="http://www.elephantsandanalytics.com.au/blogposts/tag/engagement/http://www.elephantsandanalytics.com.au/blogposts/tag/engagement/" target="_blank">previous posts</a>, you’ll know that we implemented a series of metrics for engagement measurement, culminating in a per-visitor score.</p>
<p>I wanted to share with you some of the insights and benefits of doing all of this, particularly in Discover.</p>
<h3>An Engaged Segment</h3>
<p>If you remember from the <a href="http://www.elephantsandanalytics.com.au/blogposts/elusive-engagement/" target="_blank">previous post</a>, we talked about using a total of seven different metrics to try to ascertain engagement, or, when used in combination, could identify an engaged user segment.</p>
<p>The final metric was a measure of interaction and there were two ways to implement; either by just counting the number of visitors that participated in specific actions on your site, or the second way; by creating <a href="http://www.elephantsandanalytics.com.au/blogposts/the-icing-on-the-visitor-scoring-cake/" target="_blank">a scoring methodology</a> at the visitor level and leveraging that as the final metric.</p>
<p>A little tougher to do, as it involved some additional code across the site, but definitely implementable, and now, we’re able to use that information to gain even greater insights.</p>
<blockquote><p><font color="#232323" face="Trebuchet MS">The reason you should segment is because not everyone on your site converts – in fact, probably only around 3-5% actually do what you want them to do.&#160; So you use segmentation to analyse those that have converted and try to understand what made them different, what their different behaviours were, and if possible, try to use that as predictors of future behaviour by the other 95-97%, so that you can lift conversions.</font></p>
</blockquote>
<h3>Creating the engaged segment</h3>
<p>Using Discover we created a Visitor container that contained the following rules, which we had previously determined worked best for our business. </p>
<p><a href="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/07/engaged_visitor_segment_in_discover.png"><img style="background-image: none; border-bottom: 0px; border-left: 0px; padding-left: 0px; padding-right: 0px; display: inline; border-top: 0px; border-right: 0px; padding-top: 0px" title="engaged_visitor_segment_in_discover" border="0" alt="engaged_visitor_segment_in_discover" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/07/engaged_visitor_segment_in_discover_thumb.png" width="644" height="471" /></a></p>
<p>The rules applied are from 6 of the original 7 indexes that defined engagement for us:</p>
<ol>
<li><strong>Click Depth Index</strong> – which captures the contribution of page and event views </li>
<li><strong>Duration Index</strong> – capturing the contribution of time spent on site </li>
<li><strong>Recency Index</strong> – which captures the visitor’s “visit velocity”—the rate at which visitors return to the web site over time </li>
<li><strong>Loyalty Index</strong>- the level of long-term interaction the visitor has with the brand, site, or product(s) </li>
<li><strong>Brand Index</strong> – the apparent awareness of the visitor of the brand, site, or product(s) </li>
<li><strong>Interaction Index</strong> – visitor interaction with content or functionality designed to increase level of Attention</li>
</ol>
<p>Notice the counts at the bottom of the segment creator – those seem to be a bit confusing as the number on the left (216 Visitors) represents the number of visitors that meet the criteria of the segment, but the number on the right (1,071,458 visitors) does not appear to be a count of visitors for the timeframe (for some reason I have yet to figure out).</p>
<p>Additionally, for this particular segmentation example, I wanted to ensure that our engaged visitors have actually become a lead (one of our primary goals).&#160; So our segment includes that, as well as them having a score of greater than 200, which means they’re interacting with a fair amount of content or doing a fair amount of activity (such as applying to come to study with us).</p>
<p>Saving the segment, it’s then ready for use.</p>
<h3>Using the segment</h3>
<p>One of the first things I looked at was where our engaged users were coming from, their average scores, conversion rates and application rates (or purchase rates), compared to all visitors who are not staff or students.</p>
<p><a href="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/07/engaged_visitors_by_traffic_source.png"><img style="background-image: none; border-bottom: 0px; border-left: 0px; padding-left: 0px; padding-right: 0px; display: inline; border-top: 0px; border-right: 0px; padding-top: 0px" title="engaged_visitors_by_traffic_source" border="0" alt="engaged_visitors_by_traffic_source" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/07/engaged_visitors_by_traffic_source_thumb.png" width="644" height="366" /></a></p>
<p>And I fell off my chair.</p>
<p>While the number is quite small comparatively, due in part to the timeframe I’m using, the score, lead conversion rate (leads/visitors) and application rate (applications/visitors), are significantly higher.&#160; This is to be expected due to the segment, but I wasn’t quite expecting the numbers to be that high.</p>
<h3>Visual Site Analysis</h3>
<p>I was keen to understand, visually, where these highly engaged users go on our site, so I used the Pathing Site Analysis report in Discover (one of my personal favourites).</p>
<p>Firstly I started with all visits to get a sense of what they do across common pages that we want them to interact with:</p>
<p><a href="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/07/site_analysis_all_visits.png"><img style="background-image: none; border-bottom: 0px; border-left: 0px; padding-left: 0px; padding-right: 0px; display: inline; border-top: 0px; border-right: 0px; padding-top: 0px" title="site_analysis_all_visits" border="0" alt="site_analysis_all_visits" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/07/site_analysis_all_visits_thumb.png" width="644" height="400" /></a></p>
<p>Fairly widespread usage of key pages.&#160; The thickness of the arrow indicated volume of traffic from one page to another – the bulk of traffic goes to the Courses homepage, from the site home page.</p>
<p>Next, I applied the same engaged segment:</p>
<p><a href="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/07/site_analysis_leads.png"><img style="background-image: none; border-bottom: 0px; border-left: 0px; padding-left: 0px; padding-right: 0px; display: inline; border-top: 0px; border-right: 0px; padding-top: 0px" title="site_analysis_leads" border="0" alt="site_analysis_leads" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/07/site_analysis_leads_thumb.png" width="644" height="285" /></a></p>
<p>Ok, I must need velcro pants because I fell off my chair again.</p>
<p>It appears that our highly engaged users take a whole different path.&#160; The colour indicates their propensity to become a lead.&#160; The big red steps are basically the lead capture process through our main tool – Figure Out Your Course.</p>
<p>And they seem to browse around first within courses then become a lead – which is also good to know.&#160; But once they become a lead, they tend to leave the site – which means we need to ensure that we’re effectively communicating with them through other channels, such as email at a later date.</p>
<p>Breaking down the traffic sources</p>
<p><a href="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/07/Time-Spent-Engaged.png"><img style="background-image: none; border-bottom: 0px; border-left: 0px; padding-left: 0px; padding-right: 0px; display: inline; border-top: 0px; border-right: 0px; padding-top: 0px" title="Time Spent Engaged" border="0" alt="Time Spent Engaged" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/07/Time-Spent-Engaged_thumb.png" width="616" height="484" /></a></p>
<p>In breaking down the Organic Search by time spent, we also see that a significant portion of highly engaged visitors spend more than 10 minutes on the site, and are more likely to convert to leads having done so, as compared to all visitors – another significant insight for us to use.</p>
<h3>In summary</h3>
<p>This is just one example of many that could be used on your site.&#160; Once you’ve identified your engaged users, you can segment them further by demographics, or by customer type, or by content viewed, or by member/non-member and so forth.</p>
<p>You can view revenue by engaged/non engaged (bound to be vastly different), or average order value etc.&#160; </p>
<p>If you use Test&amp;Target, you’ll be in a great position to leverage the engaged user segment, targeting non-engaged users differently to increase their engagement levels.</p>
<p>All of this will help you gain better understanding into their behaviours, so that you can then further optimise your site to improve those conversions.</p>
<p>I’m keen to hear from others that have used Visitor Scoring, or Engagement Metrics across their site, coupled with Test &amp; Target to lift conversions.&#160; Let me know what your thoughts or successes are.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.elephantsandanalytics.com.au/blogposts/visitor-scoring-the-engaged-visitor-segment/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Search&amp;Promote on steroids</title>
		<link>http://www.elephantsandanalytics.com.au/blogposts/search-and-promote-on-steroids/</link>
		<comments>http://www.elephantsandanalytics.com.au/blogposts/search-and-promote-on-steroids/#comments</comments>
		<pubDate>Mon, 18 Jul 2011 06:52:48 +0000</pubDate>
		<dc:creator>Jerome Richard</dc:creator>
				<category><![CDATA[Search&Promote]]></category>
		<category><![CDATA[behavioural targeting]]></category>
		<category><![CDATA[content relevance]]></category>
		<category><![CDATA[internal search]]></category>
		<category><![CDATA[keywords]]></category>
		<category><![CDATA[Search]]></category>
		<category><![CDATA[seo]]></category>
		<category><![CDATA[SiteCatalyst]]></category>
		<category><![CDATA[Strategies]]></category>
		<category><![CDATA[targeting content]]></category>
		<category><![CDATA[Test&Target]]></category>

		<guid isPermaLink="false">http://www.elephantsandanalytics.com.au/?p=649</guid>
		<description><![CDATA[<a href="http://www.elephantsandanalytics.com.au/blogposts/search-and-promote-on-steroids/"><img align="left" hspace="5" width="75" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/07/Current-Murdoch-multi-source-search-300x206.jpg" class="alignleft wp-post-image tfe" alt="Current Murdoch multi source search" title="Current Murdoch multi source search" /></a>When it comes to searching across the web, we all know that Google is king, but does this still hold true across your own internal network?

Over the past 12 months we have wrestled with this question, particularly in an environment with multiple search mechanisms, manually maintained indexes, and masses of sites that were created when metadata was primarily used to categorise instead of search.]]></description>
			<content:encoded><![CDATA[<div class="tweetmeme_button" style="float: right; margin-left: 10px;">
			<a href="http://api.tweetmeme.com/share?url=http%3A%2F%2Fwww.elephantsandanalytics.com.au%2Fblogposts%2Fsearch-and-promote-on-steroids%2F"><br />
				<img src="http://api.tweetmeme.com/imagebutton.gif?url=http%3A%2F%2Fwww.elephantsandanalytics.com.au%2Fblogposts%2Fsearch-and-promote-on-steroids%2F&amp;source=timelleston&amp;style=normal&amp;b=2" height="61" width="50" /><br />
			</a>
		</div>
<p>When it comes to searching across the web, we all know that Google is king, but does this still hold true across your own internal network?</p>
<p>Over the past 12 months we have wrestled with this question, particularly in an environment with multiple search mechanisms, manually maintained indexes, and masses of sites that were created when metadata was primarily used to categorise instead of search.</p>
<p>In a series of posts, I&#8217;m going to go through our experiences in improving <a title="Murdoch internal search" href="http://search.murdoch.edu.au/?q=timetable" target="_blank">search across our internal network</a> &#8211; I&#8217;m not suggesting we have found the magic search bullet, or that we&#8217;re anywhere near finished tweaking and tinkering, but I do know we&#8217;re a hell of a lot closer than where we were at this time last year.</p>
<h3>The problem</h3>
<p>In our travels across campus, we kept hearing &#8220;I can&#8217;t find what I&#8217;m looking for!&#8221;  &#8211; not surprising, given that we had;</p>
<ol>
<li>500+ individual sites, ranging in age (earliest was 1997), metadata (none to Dublin Core to &#8216;something&#8217;) and ownership</li>
<li>Inconsistent use of key SEO elements, such as title, headings, tags and meta descriptions across the majority of our sites</li>
<li>Multiple sources of content and internal search mechanisms, each with their own set of search results</li>
<li>Manually maintained indexes, all categorised and sub-related, together with an in-house redirect mechanism</li>
<li>An internal audience of staff and students with heavily cyclical search requests &#8211; a search for &#8216;physics&#8217; at the beginning of semester is more likely to be for text books, and at the end of semester past exam papers</li>
</ol>
<p>Image: Multiple source-centric result sets;</p>
<p><a href="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/07/Current-Murdoch-multi-source-search.jpg"><img class="alignnone size-medium wp-image-650" title="Current Murdoch multi source search" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/07/Current-Murdoch-multi-source-search-300x206.jpg" alt="Current Murdoch multi source search" width="300" height="206" /></a></p>
<p>Given Google&#8217;s dominance in search, we quickly went down the path of a Google Search Appliance, or &#8216;Mini&#8217;, which is a self contained rack mounted system that gives you God-like powers over the Google algorithm. We were bringing in a little bit of Google in to magically transform our disparate set of sites into a cohesive set of search results.</p>
<p>Once plugged in, the Mini worked really well &#8211; for pages that were properly formatted for organic search.</p>
<p>Pages that were missing or incorrectly using titles, headings and metadata didn&#8217;t fare so well, and we found the search results were not the most relevant, as the Mini couldn&#8217;t make much sense of most of the content it crawled. We also found that there was no clear way to incorporate the feeds from other systems, with the &#8220;how do I&#8230;&#8221; answers primarily provided by a community of Search Appliance users and resellers, and not Google themselves.</p>
<p>Given the wide ownership of the sites we were working with, updating each with appropriate SEO friendly content was unrealistic. What we needed was a way to;</p>
<ol>
<li>compensate for the lack of SEO content,</li>
<li>incorporating multiple sources/ formats of content,</li>
<li>allow for cyclical requests to ensure the most relevant results appear, and</li>
<li>combine all the different sources of search results into a single set of user-centric search results.</li>
</ol>
<h3>Enter Adobe Search&amp;Promote</h3>
<p>If you&#8217;re a regular visitor to this blog, it will come as no surprise that Tim is a power user of Omniture products, steadily working his way around the product wheel. We became aware of the <a title="Omniture Search&amp;Promote" href="http://www.omniture.com/en/products/conversion/searchandpromote">Search&amp;Promote</a> product (then called SiteSearch) which promised to solve our key internal search issues.</p>
<p>Search&amp;Promote uses a search algorithm to organically crawl your sites, in addition to ranking rules based on a wide range of configurable data. Once you&#8217;ve defined your rules, you can adjust the overall balance between your ranking rules and natural search relevance.</p>
<p>Where there is a lack of metadata, Search&amp;Promote can be configured to dynamically inject metadata on crawl, based on a URL pattern. Additional custom metadata can also be injected to create facets (filters) that allow users to drill further down into predefined categories.</p>
<p>If your multiple sources of content can be transformed into XML feeds, then that content can be crawled, categorised, and integrated with the organic results by Search&amp;Promote.</p>
<p>Yes, there are other internal search products on the market that will do the above, however there is one thing that Search&amp;Promote has over its competitors &#8211; the ability to <a title="Integrate Search and Promote with SiteCatalyst" href="http://www.elephantsandanalytics.com.au/blogposts/search-promote-the-implementation-part-1">tightly integrate with SiteCatalyst</a> and Test &amp; Target.</p>
<p>We&#8217;ve known for some time that internal search terms follow highly cyclical patterns as our student (and staff) needs change over the semester. We&#8217;ve helped them find what they&#8217;re looking for using of real-time SiteCatalyst data in search-as-you-type and tag cloud mechanisms, however with Search&amp;Promote we now have the opportunity to take internal search to the next level.</p>
<p>In the report below (7 day moving average) you can see two popular search results across three semesters peaking at different times during the semester;</p>
<p><a href="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/07/bookshop-and-timetable-keywords-over-three-semesters.jpg"><img class="alignnone size-medium wp-image-651" title="bookshop and timetable keywords over three semesters" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/07/bookshop-and-timetable-keywords-over-three-semesters.jpg" alt="bookshop and timetable keywords over three semesters" width="500" /></a></p>
<p>Notice how &#8216;bookshop&#8217; peaks at the beginning of semester, then dies down, only to peak again at the beginning of the following semester. No surprises here, but it does coincide with a significant increase in page views across the Bookshop website.</p>
<p>Then look at the results for &#8216;timetable&#8217; &#8211; there&#8217;s a peak at both the beginning and end of semester. The difference here is that people are actually looking for two different pieces of content &#8211; their semester timetable at the beginning, and their exam timetable at the end &#8211; using the same keyword. Again, the rise in search terms coincides with increased page views across each piece of content.</p>
<p>So, in theory, by looking at the last week&#8217;s worth of traffic across our group of sites, we should be able to determine what content students are looking for, then <a title="Rank results based on SiteCatalyst traffic" href="http://www.elephantsandanalytics.com.au/blogposts/search-promote-the-implementation-part-1">re-rank the search results accordingly</a>. For example, the term &#8216;timetable&#8217; at the beginning of semester will push results related to the semester timetable to the top, and at the end of the semester push results related to the exam timetable to the top.</p>
<p>Exciting stuff!</p>
<p><a title="The implementation part 1" href="http://www.elephantsandanalytics.com.au/blogposts/search-promote-the-implementation-part-1">Next post &#8211; the implementation</a>.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.elephantsandanalytics.com.au/blogposts/search-and-promote-on-steroids/feed/</wfw:commentRss>
		<slash:comments>1</slash:comments>
		</item>
		<item>
		<title>The icing on the Visitor scoring cake</title>
		<link>http://www.elephantsandanalytics.com.au/blogposts/the-icing-on-the-visitor-scoring-cake/</link>
		<comments>http://www.elephantsandanalytics.com.au/blogposts/the-icing-on-the-visitor-scoring-cake/#comments</comments>
		<pubDate>Wed, 29 Jun 2011 01:33:34 +0000</pubDate>
		<dc:creator>Tim Elleston</dc:creator>
				<category><![CDATA[Discover]]></category>
		<category><![CDATA[behavioural targeting]]></category>
		<category><![CDATA[Data warehouse]]></category>
		<category><![CDATA[engagement]]></category>
		<category><![CDATA[measuring engagement]]></category>
		<category><![CDATA[Segmentation]]></category>
		<category><![CDATA[visitor engagement]]></category>
		<category><![CDATA[visitor ID]]></category>
		<category><![CDATA[visitor interaction]]></category>
		<category><![CDATA[visitor scoring]]></category>

		<guid isPermaLink="false">http://www.elephantsandanalytics.com.au/blogposts/the-icing-on-the-visitor-scoring-cake/</guid>
		<description><![CDATA[<a href="http://www.elephantsandanalytics.com.au/blogposts/the-icing-on-the-visitor-scoring-cake/"><img align="left" hspace="5" width="75" height="75" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/06/unique_visitor_variable_thumb-150x150.png" class="alignleft wp-post-image tfe" alt="unique_visitor_variable" title="unique_visitor_variable" /></a>This is the third (but not final) post in the series on Visitor Engagement.  One of the problems with the Visitor Scoring method that I previously described, is that, at the end of the day, you’re still somewhat limited to viewing scores at the “average” level, by segment.

That presents a number of challenges because the average is precisely that…and the underlying scores vary dramatically within each segment.

But there is a way to see what each and every visitor score is, or even within the different segments…and it’s called the Unique Visitor ID.  You can see at the visitor level, how many times they’ve returned, how many “things” they’ve done, such as searches, product views, revenue etc.

This is really the icing on the proverbial cake.

]]></description>
			<content:encoded><![CDATA[<div class="tweetmeme_button" style="float: right; margin-left: 10px;">
			<a href="http://api.tweetmeme.com/share?url=http%3A%2F%2Fwww.elephantsandanalytics.com.au%2Fblogposts%2Fthe-icing-on-the-visitor-scoring-cake%2F"><br />
				<img src="http://api.tweetmeme.com/imagebutton.gif?url=http%3A%2F%2Fwww.elephantsandanalytics.com.au%2Fblogposts%2Fthe-icing-on-the-visitor-scoring-cake%2F&amp;source=timelleston&amp;style=normal&amp;b=2" height="61" width="50" /><br />
			</a>
		</div>
<p>This is the third (but not final) post in the series on Visitor Engagement.  One of the problems with the Visitor Scoring method that I <a href="http://www.elephantsandanalytics.com.au/blogposts/elusive-engagement-part-ii-visitor-scoring/" target="_blank">previously described</a>, is that, at the end of the day, you’re still somewhat limited to viewing scores at the “average” level, by segment.</p>
<p>That presents a number of challenges because the average is precisely that…and the underlying scores vary dramatically within each segment.</p>
<p>But there is a way to see what each and every visitor score is, or even within the different segments…and it’s called the Unique Visitor ID.  You can see at the visitor level, how many times they’ve returned, how many “things” they’ve done, such as searches, product views, revenue etc.</p>
<p>This is really the icing on the proverbial cake.</p>
<h2>Visitor ID</h2>
<p>There’s a seldom used implementation method in SiteCatalyst called Dynamic Variables which easily enables all of this capability.</p>
<p>All you need is a spare eVar and you’re in heaven.</p>
<h3>Step 1</h3>
<p>Simply populate an eVar with “D=s_vi” and the result is that SiteCatalyst will populate the eVar with the unique visitor cookie ID.  If you test it with WASP or something similar, you’ll only see that D=s_vi got passed, but the magic begins.</p>
<pre>s.eVar56="D=s_vi";</pre>
<h3>Step 2</h3>
<p>Go into you Admin console, and on the report suite where you want this collected, go to Conversion &gt; Unique Visitor Variable section.</p>
<p><a href="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/06/unique_visitor_variable.png"><img style="background-image: none; padding-left: 0px; padding-right: 0px; display: inline; padding-top: 0px; border-width: 0px;" title="unique_visitor_variable" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/06/unique_visitor_variable_thumb.png" alt="unique_visitor_variable" width="433" height="223" border="0" /></a></p>
<p>You’ll be presented with a dropdown of available eVars that can be selected to use as the Visitor ID…simply select the one that you’re using and hit save.</p>
<p><a href="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/06/select_unique_visitor_variable.png"><img style="background-image: none; padding-left: 0px; padding-right: 0px; display: inline; padding-top: 0px; border-width: 0px;" title="select_unique_visitor_variable" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/06/select_unique_visitor_variable_thumb.png" alt="select_unique_visitor_variable" width="564" height="173" border="0" /></a></p>
<p>That’s it – you’re done!  All there is to it.</p>
<blockquote><p>Rest assured, it does not impact anything to do with the way that SiteCatalyst measures unique visitors – its completely separate and safe to use.</p></blockquote>
<h3>And now it pops</h3>
<p>So, the first thing you’ll see is a new report on your eVar. The report is a list of all Visitor Cookie ID’s captured during the timeframe selected.  As it’s a conversion variable, you can add in whatever success events you like:</p>
<p><a href="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/06/individual_visitor_scores.png"><img style="background-image: none; padding-left: 0px; padding-right: 0px; display: inline; padding-top: 0px; border: 0px;" title="individual_visitor_scores" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/06/individual_visitor_scores_thumb.png" alt="individual_visitor_scores" width="644" height="222" border="0" /></a></p>
<p>Add in your Visitor Score and you can see what their points are.  As you can see from above, I’ve highlighted an interesting visitor (#7)…they were on their 2nd visit, they searched 12 times, viewed 16 courses and submitted an application.  Their score is currently 542.  I’m wondering if visitor #5 is a candidate for an app too…similar behaviour is forming.</p>
<h3>Segment-based Visitor ID’s</h3>
<p>Ok, now open up a report such as Campaigns (we use the Unified Traffic Sources VISTA rule so it may look a little different if you don’t use it).</p>
<p>Remember the challenge I mentioned at the top of this post…with average scores.</p>
<p>We see below that the average visitor score for Organic Search is 7.88.  But, that’s just an average.  We know that from our scoring methodology, you have to have a higher score than that if you’re interacting with content.</p>
<p><a href="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/06/visitor_scoring_campaigns.png"><img style="background-image: none; padding-left: 0px; padding-right: 0px; display: inline; padding-top: 0px; border: 0px;" title="visitor_scoring_campaigns" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/06/visitor_scoring_campaigns_thumb.png" alt="visitor_scoring_campaigns" width="644" height="198" border="0" /></a></p>
<p>So, when we break down the Search Organic by Visitor ID’s, we see a very different story.</p>
<p><a href="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/06/visitor_scoring_campaigns_visitor_id.png"><img style="background-image: none; padding-left: 0px; padding-right: 0px; display: inline; padding-top: 0px; border: 0px;" title="visitor_scoring_campaigns_visitor_id" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/06/visitor_scoring_campaigns_visitor_id_thumb.png" alt="visitor_scoring_campaigns_visitor_id" width="644" height="249" border="0" /></a></p>
<p>Look at that…the top 10 all have scores above 300!</p>
<p>So to get to an average of 7.88, we must have an awful lot of really low end scores that come in through organic search.  And actually, that makes sense…we have a lot of reference content across our site, such as Library and School content that is very popular and that’s likely where these users with low scores are going.  Not the ones we’re really interested in from this scoring standpoint though.</p>
<h3>Extracting Visitor ID’s</h3>
<p>The next fancy bit of functionality, once you’ve enabled the Unique Visitor ID, is the ability to extract those visitors that have met a certain criteria (success event).</p>
<p>If you now click on an item in, for example, the Last Campaign report (at the individual campaign tracking code level), instead of heading off to the summary page for that item (which by the way, is useful also), you’ll get a new menu:</p>
<p><a href="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/06/extract_visitor_ids_datawarehouse.png"><img style="background-image: none; padding-left: 0px; padding-right: 0px; display: inline; padding-top: 0px; border: 0px;" title="extract_visitor_ids_datawarehouse" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/06/extract_visitor_ids_datawarehouse_thumb.png" alt="extract_visitor_ids_datawarehouse" width="644" height="203" border="0" /></a></p>
<p>If you select the success event you want the visitor ID’s for, you’ll end up in a data warehouse data extract screen, where the report can be scheduled for immediate delivery:</p>
<p><a href="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/06/extract_datawarehouse.png"><img style="background-image: none; padding-left: 0px; padding-right: 0px; display: inline; padding-top: 0px; border: 0px;" title="extract_datawarehouse" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/06/extract_datawarehouse_thumb.png" alt="extract_datawarehouse" width="569" height="484" border="0" /></a></p>
<p>Here we’re extracting visitor ID’s for those that submitted an application having come to us from Google Australia.</p>
<h3>The Icing</h3>
<p>I think the real icing on this cake is the ability to look at all visitor scores at the <span style="text-decoration: underline;">individual visitor level</span>, irrespective of the segment, so that you can get an idea of what their scores are, to help better gauge those low/medium/high engagement buckets.  It’s also really useful to see at the segment too.</p>
<p>You’ll need to use Excel to process the data (and one thing I should point out is that an eVar can only have a maximum of 500,000 unique values in a given month – so if you get more visitors than that, then this might not work for you).</p>
<p>Other ways to use this is to extract emails that have responded to a campaign – if you capture the memberID in the eVar you can then extract the data for later use.</p>
<p>The next thing we need to do is re-configure our Discover segment for the interaction index and amalgamate these metrics into the overall engagement scoring methodology.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.elephantsandanalytics.com.au/blogposts/the-icing-on-the-visitor-scoring-cake/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Elusive engagement – Part II – Visitor scoring</title>
		<link>http://www.elephantsandanalytics.com.au/blogposts/elusive-engagement-part-ii-visitor-scoring/</link>
		<comments>http://www.elephantsandanalytics.com.au/blogposts/elusive-engagement-part-ii-visitor-scoring/#comments</comments>
		<pubDate>Mon, 20 Jun 2011 02:32:52 +0000</pubDate>
		<dc:creator>Tim Elleston</dc:creator>
				<category><![CDATA[SiteCatalyst]]></category>
		<category><![CDATA[behavioural targeting]]></category>
		<category><![CDATA[campaigns]]></category>
		<category><![CDATA[Conversions]]></category>
		<category><![CDATA[Data warehouse]]></category>
		<category><![CDATA[Discover]]></category>
		<category><![CDATA[engagement]]></category>
		<category><![CDATA[measuring engagement]]></category>
		<category><![CDATA[saint]]></category>
		<category><![CDATA[Segmentation]]></category>
		<category><![CDATA[Test&Target]]></category>
		<category><![CDATA[visitor engagement]]></category>
		<category><![CDATA[visitor ID]]></category>
		<category><![CDATA[visitor interaction]]></category>
		<category><![CDATA[visitor scoring]]></category>

		<guid isPermaLink="false">http://www.elephantsandanalytics.com.au/?p=616</guid>
		<description><![CDATA[<a href="http://www.elephantsandanalytics.com.au/blogposts/elusive-engagement-part-ii-visitor-scoring/"><img align="left" hspace="5" width="75" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/06/visitor_scoring_tag_cloud_thumb.png" class="alignleft wp-post-image tfe" alt="Visitor Scoring Tag Cloud" title="Visitor Scoring Tag Cloud" /></a>This is a follow on post to my previous one about measuring that elusive engagement.  This post focuses on the aspect of applying a score to visitor interactions, as they interact with your content and applications.

Visitor scoring is fairly simple – especially in SiteCatalyst, and by leveraging the data in Discover through segmentation, (and ultimately in SiteCatalyst 15), it’ll give you even more insight into visitor engagement.

Visitor scoring measures and assigns a relative value to individual customers and prospects based on their actions and behaviors over time. You can determine intent and engagement – even before visitors convert.

Once you’ve identified your most valuable visitors, you can dissect their actions to determine the campaigns, keywords, referring sites and offline touch points that engage them – and invest more on these efforts.]]></description>
			<content:encoded><![CDATA[<div class="tweetmeme_button" style="float: right; margin-left: 10px;">
			<a href="http://api.tweetmeme.com/share?url=http%3A%2F%2Fwww.elephantsandanalytics.com.au%2Fblogposts%2Felusive-engagement-part-ii-visitor-scoring%2F"><br />
				<img src="http://api.tweetmeme.com/imagebutton.gif?url=http%3A%2F%2Fwww.elephantsandanalytics.com.au%2Fblogposts%2Felusive-engagement-part-ii-visitor-scoring%2F&amp;source=timelleston&amp;style=normal&amp;b=2" height="61" width="50" /><br />
			</a>
		</div>
<p>This is a follow on post to my previous one about <a href="http://www.elephantsandanalytics.com.au/blogposts/elusive-engagement/">measuring that elusive engagement</a>.&#160; This post focuses on the aspect of applying a score to visitor interactions, as they interact with your content and applications.</p>
<p>Visitor scoring is fairly simple – especially in SiteCatalyst, and by leveraging the data in Discover through segmentation, (and ultimately in SiteCatalyst 15), it’ll give you even more insight into visitor engagement.</p>
<p>Visitor scoring measures and assigns a relative value to individual customers and prospects based on their actions and behaviors over time. You can determine intent and engagement – even before visitors convert.</p>
<p>Once you’ve identified your most valuable visitors, you can dissect their actions to determine the campaigns, keywords, referring sites and offline touch points that engage them – and invest more on these efforts.</p>
<h2>Scoring</h2>
<p>T<a href="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/06/visitor_scoring_tag_cloud.png"><img style="background-image: none; border-right-width: 0px; padding-left: 0px; padding-right: 0px; display: inline; float: right; border-top-width: 0px; border-bottom-width: 0px; border-left-width: 0px; padding-top: 0px" title="Visitor Scoring Tag Cloud" border="0" alt="Visitor Scoring Tag Cloud" align="right" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/06/visitor_scoring_tag_cloud_thumb.png" width="244" height="112" /></a>he basic premise of a visitor score is to give them “points” for certain activities.&#160; What score you decide to give them is entirely up to you…the important thing is that they accrue points over time, and you can use those points to create segments of visitors that have exceeded certain thresholds.</p>
<p>In doing so, you’ll be able to compare different visitors, for example, those with a high score, to those with a low score, from different traffic sources, or across different campaigns.</p>
<p>The theory behind this is that visitors with higher scores are likely to be more engaged – they’ve accrued more points over time, by doing the things you want them to do.&#160; It’s not just looking at conversions, although they will probably feature in your scoring methodology.</p>
<p>Imagine for a moment that you have a number of visitors:</p>
<p>Visitor 1 – comes to your site from Organic search, looks at 5 different products, watches 2 videos, signs up for your newsletter, but doesn’t buy anything.</p>
<p>Visitor 2 – comes to your site from Organic search, looks at 1 product and buys it.</p>
<p>Visitor 3 – comes to your site through an email campaign, and views 8 of your products.</p>
<p>Visitor 4 – comes to your site through Paid Search, looks at searches for a product, views it once and then looks at 3 FAQs.</p>
<p>Which visitor is more valuable to you?&#160; Who is more engaged?&#160; Visitor scoring will assist you to better understand the answer to that – and when you slot this Visitor Scoring methodology into the <a href="http://www.elephantsandanalytics.com.au/blogposts/elusive-engagement/">Interaction Index</a>, and use Discover, you really do get a good proxy for engagement.</p>
<p>Ultimately most sites exist for a specific reason, whether it be to convert the visitor to a purchase, or allow them to self serve, or engage them with your content etc.&#160;&#160; And we all want them to do that.&#160; But only a small percentage will.&#160; In fact, in general, it’s around 3-5% of visitors that actually “convert”.</p>
<h2>First things first</h2>
<p>What you need to do initially is agree on a set of interactions across your site, and then apply an arbitrary score to them, either between 1 and 10 or 1 and 100.</p>
<p>For example:</p>
<ol>
<li>Home page viewed or Landing Page Viewed = 1 pt </li>
<li>View a general content page = 5 pts </li>
<li>View a Product = 10 pts </li>
<li>Search = 20 pts (I tend to think that if a visitor is going to take the time to search for something they can’t find, they’re more engaged, hence the higher score) </li>
<li>Watch a video = 30 pts </li>
<li>Use an interactive tool = 40 pts </li>
<li>Sign Up for a newsletter = 50 pts </li>
<li>Provide feedback/rate and review/comment = 75 pts </li>
<li>Buy a product or conduct a self service transaction = 100 pts </li>
</ol>
<p>Don’t worry about the actual scores, but do leave room for additional interactions that you can add in if you need to (but remember to communicate it out if you do add in others, as scores will go up).</p>
<p>Now that you’ve scored various activities, you need to implement the code to measure those interactions.</p>
<h2>Implementing the scoring</h2>
<p>In SiteCatalyst that’s easy enough to do – you need an eVar and a success event.</p>
<p>Set up the success event as a Counter Event.&#160; </p>
<blockquote><p>Note that you can now have counter events where they take a value other than 1, which is what is needed for the&#160; scoring.&#160; However, I believe you’ll need version H23 of the s_code to support this.&#160; </p>
</blockquote>
<p>Create the eVar as a Counter eVar, not a text eVar.</p>
<p>Visitor scoring is done by simply passing the score value as a +number into the eVar and the success event is set with the =number (yes, you no longer need to pass the event through the s.product string).</p>
<p>So, for example, on your homepage, you simply add the following:</p>
<pre>s.events=&quot;event1=1&quot;; s.eVar1=&quot;+1&quot;;</pre>
<p>On your search page, you’d include:</p>
<pre>s.events=&quot;event1=20&quot;; s.eVar1=&quot;+20&quot;;</pre>
<p>(The above obviously assumes you’ve used event1 and eVar1 for Visitor Scoring.</p>
<p>Complete that process for each of the key interactions and you’re set.&#160; We implemented ours directly into our s_code through a variety of s.pageName value matches, or product views, or other success events occurring.</p>
<p>To put this in context, we’ve implemented the following scoring:</p>
<ol>
<li>Homepage view = 1pt </li>
<li>Searched for something = 5pts </li>
<li>Viewed a course = 20pts </li>
<li>Completed a form = 30pts </li>
<li>Used one of our interactive tools = 50pts </li>
<li>Opted in to something = 70pts </li>
<li>Submitted an application = 100pts </li>
</ol>
<h3>Making it legible</h3>
<p>First thing you need to do when you implement this type of thing is make it all a bit more usable.</p>
<p>When you look at the raw data (your eVar against conversions), you’ll see something like:</p>
<p><a href="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/06/scoring.png"><img style="background-image: none; border-right-width: 0px; padding-left: 0px; padding-right: 0px; display: inline; border-top-width: 0px; border-bottom-width: 0px; border-left-width: 0px; padding-top: 0px" title="Visitor scoring" border="0" alt="Visitor scoring raw report" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/06/scoring_thumb.png" width="443" height="352" /></a></p>
<p>Remember that the success event (Application Submitted) is associated back to the value seen in the eVar, when the success event was applied – so, in the example above, 37 apps were submitted when visitors had a score of 190; 22 had a score of 211, etc.&#160; Notice also that as we’re showing both Apps and Leads, we also see that they don’t correspond; Leads has a very different scoring result (see below).</p>
<p>Overall, it doesn’t tell you much – you actually want to group the eVars together.&#160; So, use SAINT to classify them into buckets.&#160; </p>
<blockquote>
<p>Important Tip: When you use Excel to classify your eVar, the key column will be the interaction score.&#160; You need to keep that column showing 2 decimal places – when you export from SAINT, it has the decimal places on it, when you open in Excel, the decimal places disappear, and if you re-save without decimals and upload again, they keys will be different, and the reports won’t work.&#160; So, put the key column to 2 decimal places and then classify it.</p>
</blockquote>
<p>That brings about the problem of what your buckets should be…well, that’s up to you.&#160; Only your data will tell you that.&#160; But, you can experiment with different buckets to see what works best.&#160; To be honest, it’s best to do this in Excel, rather than SAINT, as you’ll want instant gratification.&#160; And you’ll obviously need data collected before you can classify…so it’s best to run it without classifications for a while.</p>
<p>We classified ours following a bit of analysis using Excel to figure out the best buckets for Applications Submitted and Optins.&#160; As it turned out, after a lot of playing around, we chose a logarithmic scale, as it seemed to group everything the best:</p>
<p><a href="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/06/apps_score.png"><img style="background-image: none; border-right-width: 0px; padding-left: 0px; padding-right: 0px; display: inline; border-top-width: 0px; border-bottom-width: 0px; border-left-width: 0px; padding-top: 0px" title="application based scoring" border="0" alt="Application based scoring" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/06/apps_score_thumb.png" width="490" height="296" /></a></p>
<p>What we see in Excel is that with these buckets, 80% of applications occur before a visitor has a score of 320.&#160; We also note that most apps occur when visitors have a score of between 160-320…our sweet spot.</p>
<p>So, using SAINT, we classified our Engagement Value eVar into our buckets and uploaded back to SAINT.&#160; </p>
<blockquote>
<p>Tip: Due to the size of the file, we typically use an FTP upload now – it took less than 10 minutes to classify the data in the reports.</p>
</blockquote>
<p>Now re-run the above SiteCatalyst report, this time using your buckets:</p>
<p><a href="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/06/sitecatalyst_visitor_scoring.png"><img style="background-image: none; border-right-width: 0px; padding-left: 0px; padding-right: 0px; display: inline; border-top-width: 0px; border-bottom-width: 0px; border-left-width: 0px; padding-top: 0px" title="SiteCatalyst Visitor Scoring Report" border="0" alt="SiteCatalyst Visitor Scoring Report" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/06/sitecatalyst_visitor_scoring_thumb.png" width="644" height="241" /></a></p>
<p>Remember above I said that leads obviously have a very different score?&#160; You can see that in the above report, that Lead Completes tend to happen when the visitor has a score of between 40 and 160.</p>
<p><a href="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/06/lead_score.png"><img style="background-image: none; border-right-width: 0px; padding-left: 0px; padding-right: 0px; display: inline; border-top-width: 0px; border-bottom-width: 0px; border-left-width: 0px; padding-top: 0px" title="Leads scoring" border="0" alt="Leads scoring" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/06/lead_score_thumb.png" width="545" height="297" /></a></p>
<p>What we see from Excel with Leads is that 80% of leads occur before a visitor has a score of 80 – which means that those that become leads, do so pretty quickly; they haven’t visited much other content (otherwise their score would be higher) – which is great news for us!</p>
<p>Another way to classify the scores is to set “low, medium, and high” buckets for engaged visitors.&#160; I’m still trying to figure out what we should use as those buckets, as we have a very large spread.&#160; Standard Deviation will probably assist in that one eventually.</p>
<h3>Calculated Metrics</h3>
<p>At this point in time, you probably also want to create a few calculated metrics to get some averages out.</p>
<p>Ones that I’d recommend are:</p>
<ol>
<li>Score per Visit = [Engagement Score] / [Visits] </li>
<li>Score per Search = [Engagement Score] / [Instances (Report-Specific)] </li>
<li>Score per Referrer = [Engagement Score] / [Instances (Report-Specific)] </li>
</ol>
<p>Why is Instances in there twice?&#160; Because a) Visits are not available across every report type and b) the naming convention just makes it a bit easier to understand (IMHO).</p>
<p>Did you know you can also trend calculated metrics?</p>
<p>Now that you’ve got all this wonderful new capability, what do you do with it…?</p>
<h3>Segment it (of course)</h3>
<p><a href="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/06/geo_engagement.png"><img style="background-image: none; border-right-width: 0px; margin: 0px 0px 0px 10px; padding-left: 0px; padding-right: 0px; display: inline; float: right; border-top-width: 0px; border-bottom-width: 0px; border-left-width: 0px; padding-top: 0px" title="Discover Geo Scoring" border="0" alt="Discover Geo Scoring" align="right" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/06/geo_engagement_thumb.png" width="210" height="244" /></a>There’s all sorts of different ways you can use this…all basically segmentation based.</p>
<p>You can look at traffic sources, campaigns, keywords, geographics, user type segments, etc.&#160; You can trend and compare your segmented values over time.</p>
<p>In the example on the right, we see that while Australian visitors have an average score of 5.82, the highlighted items have much larger scores, indicating that they are engaging with more of the things we want them to do.&#160; The example on the right was extracted using Discover, as in SiteCatalyst 14 the capability with geo-demographic reports is somewhat limited to country/visits.</p>
<p>&#160;</p>
<p>In the next example, we’re looking at scores by course interest.&#160; The course category is actually an eVar that is set in various places across the site – similar to a product category.&#160; When a visitor browsers different bits of content, we’ll set their course category differently, which is then used for <a href="http://www.elephantsandanalytics.com.au/blogposts/test-and-target-silly-season-has-arrived/" target="_blank">Test &amp; Target</a> purposes…but works well here too.</p>
<p><a href="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/06/course_interest_scores.png"><img style="background-image: none; border-right-width: 0px; padding-left: 0px; padding-right: 0px; display: inline; border-top-width: 0px; border-bottom-width: 0px; border-left-width: 0px; padding-top: 0px" title="Product Interest Scoring" border="0" alt="Product Interest Scoring" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/06/course_interest_scores_thumb.png" width="585" height="70" /></a></p>
<p>We see that while Undergrad had more course views during this short time frame, they scored actually slightly less than Postgrad visitors.&#160; This would indicate that PG visitors tend to read more, which would also make sense, as it’s a bigger purchase decision for them.</p>
<p>And as a final example, scores by different campaign types (Organic, Paid, Campaigns, etc).</p>
<p><a href="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/06/Campaign_score.png"><img style="background-image: none; border-right-width: 0px; padding-left: 0px; padding-right: 0px; display: inline; border-top-width: 0px; border-bottom-width: 0px; border-left-width: 0px; padding-top: 0px" title="Campaign Scoring" border="0" alt="Campaign Scoring" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/06/Campaign_score_thumb.png" width="580" height="203" /></a></p>
<p>Hmmm…seems Paid Search is doing really well; not a huge amount of traffic during this period, but they are interacting a lot.&#160; Break that down by keyword or Adword group and you’ll get even more insight.</p>
<p>Here we’re looking at Branded vs. Non Branded keywords (and their top keywords):</p>
<p><a href="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/06/branded_non_branded_organic_term_score.png"><img style="background-image: none; border-right-width: 0px; padding-left: 0px; padding-right: 0px; display: inline; border-top-width: 0px; border-bottom-width: 0px; border-left-width: 0px; padding-top: 0px" title="Branded Non Branded Search Term Scoring" border="0" alt="Branded Non Branded Search Term Scoring" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/06/branded_non_branded_organic_term_score_thumb.png" width="561" height="314" /></a></p>
<p>Seems that branded search terms generate a higher interaction, and in fact when they type in the full name of the university, they have the highest interaction.</p>
<h3>Multi-scoring techniques</h3>
<p>You’re not limited to having just one scoring methodology.&#160; We’re actually in the process of implementing a second one for a completely different reason.&#160; All you need is a spare eVar, another success event, and bit of time.&#160; Rinse and repeat!</p>
<h3>Comparative and Trending</h3>
<p>Of course, you can also trend on the calculated metrics to ensure your overall interaction score is going in the right direction, and you can trend by different segments too.</p>
<p>Likewise, you can do comparative analysis using different dates to compare the interaction scores.</p>
<h3>Extending the scoring</h3>
<p>In SiteCatalyst 15, you can leverage the segments for visitors with scores higher than X – you can either use the value of the event, or you can use the SAINT classifications.&#160; </p>
<p>Additionally, you can use these in DataWarehouse and Discover – or start from Discover and put the segments back into SiteCatalyst.</p>
<p>And, you can leverage the segments and scores in Test &amp; Target to further optimise user journeys and conversions.</p>
<p>There’s just a whole heap of different ways to use this information.</p>
<h3>Next post</h3>
<p>In my next post, I’ll combine the above interaction Visitor scoring into the Discover segments for a full on Engagement Analysis, replacing the previously described interaction score with this one.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.elephantsandanalytics.com.au/blogposts/elusive-engagement-part-ii-visitor-scoring/feed/</wfw:commentRss>
		<slash:comments>3</slash:comments>
		</item>
		<item>
		<title>Test and Target silly season has arrived</title>
		<link>http://www.elephantsandanalytics.com.au/blogposts/test-and-target-silly-season-has-arrived/</link>
		<comments>http://www.elephantsandanalytics.com.au/blogposts/test-and-target-silly-season-has-arrived/#comments</comments>
		<pubDate>Fri, 03 Jun 2011 02:00:00 +0000</pubDate>
		<dc:creator>Tim Elleston</dc:creator>
				<category><![CDATA[Test&Target]]></category>
		<category><![CDATA[AB testing]]></category>
		<category><![CDATA[behavioural targeting]]></category>
		<category><![CDATA[campaigns]]></category>
		<category><![CDATA[Conversions]]></category>
		<category><![CDATA[nested mbox]]></category>
		<category><![CDATA[nested mboxes]]></category>
		<category><![CDATA[Segmentation]]></category>

		<guid isPermaLink="false">http://www.elephantsandanalytics.com.au/?p=560</guid>
		<description><![CDATA[<a href="http://www.elephantsandanalytics.com.au/blogposts/test-and-target-silly-season-has-arrived/"><img align="left" hspace="5" width="75" height="75" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/05/campaign_complexity_thumb-150x150.png" class="alignleft wp-post-image tfe" alt="campaign_complexity" title="campaign_complexity" /></a>Here's a real humdinger with you.

It’s campaign time again.  Not just any old campaign; it’s our main recruitment campaign of the year.

What we normally do on this campaign is behaviorally target content to users based on their application stage. 

Why?  Because we know from previous tests that behaviorally targeting content for re-engagement purposes not only lifts our application completion rate, but provides more relevance to the user when they visit our site – instead of just seeing a standard campaign message each time.  And relevance is proven to lift conversions.

But this time, the gates of hell opened and out rode the fifth horseman...with a complicated double somersault backflip twist.]]></description>
			<content:encoded><![CDATA[<div class="tweetmeme_button" style="float: right; margin-left: 10px;">
			<a href="http://api.tweetmeme.com/share?url=http%3A%2F%2Fwww.elephantsandanalytics.com.au%2Fblogposts%2Ftest-and-target-silly-season-has-arrived%2F"><br />
				<img src="http://api.tweetmeme.com/imagebutton.gif?url=http%3A%2F%2Fwww.elephantsandanalytics.com.au%2Fblogposts%2Ftest-and-target-silly-season-has-arrived%2F&amp;source=timelleston&amp;style=normal&amp;b=2" height="61" width="50" /><br />
			</a>
		</div>
<p>I thought I’d share a real humdinger with you.</p>
<p><a href="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/05/campaign_complexity.png"><img style="background-image: none; padding-left: 0px; padding-right: 0px; display: inline; float: right; padding-top: 0px; border-width: 0px;" title="campaign_complexity" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/05/campaign_complexity_thumb.png" border="0" alt="campaign_complexity" width="350" height="222" align="right" /></a>It’s campaign time again.  Not just any old campaign, it’s our main recruitment campaign of the year.</p>
<p>What we normally do on this campaign is behaviorally target content to users based on their application stage.</p>
<p>Why?  Because we know from previous tests that behaviorally targeting content for re-engagement purposes not only lifts our application completion rate, but provides more relevance to the user when they visit our site – instead of just seeing a standard campaign message each time.</p>
<p>Given the value of an application, and the lift we see, it’s well worth the effort to go down this path.</p>
<p>But this time, the gates of hell opened and out rode the fifth horseman.</p>
<p>We typically use 4 different stages, with one experience (content) per stage.  The challenge we always faced was that for each stage, we always wanted to run A/B tests to see which converted better – but could never figure out how to do it when it’s coupled with a behaviorally targeted campaign.</p>
<p>A few months ago, I worked with one of the Omniture Test &amp; Target genius rock stars, implementation engineer Randall, who worked through a nested mbox example with me, which could be used to nest A/B tests within a single Landing Page campaign.  Unfortunately at the time we didn’t get to implement anything (or even try it – but it looked great on paper).</p>
<p>Knowing that our primetime Mid Year recruitment campaign period was nearly on us, I dusted off the email and had a good ‘ole read, as I felt it had some opportunities for us in a variety of ways.</p>
<h3>And so the madness begins…</h3>
<p>Always up for a challenge, I strapped on my Test &amp; Target boots, and suggested that we could perhaps, possibly, maybe, ‘ish, try, have a crack at, putting together a behaviorally targeted campaign, where at each stage of the process we not only change the offer (easy) but run an A/B test (difficult) to test how well different offers convert people to the next stage.</p>
<p>Be careful what you wish for…because not only did they like that idea, they compounded it by throwing in another campaign on top of that one.</p>
<p>Mid Year campaign is normally restricted to Undergrad recruitment.  At least, that’s been the (now) historical position.</p>
<p>But no, this year, we’re doing simultaneous Undergrad and Postgrad Mid Year campaigns.</p>
<p>Yikes!!!  Go big or go home!  In for a penny, in for a pound.</p>
<p>So, to summarize, we want a simultaneous 4 stage behaviorally targeted campaign with a series of A/B tests within them.  And we need to switch users between campaigns based on whether they meet certain criteria, or whether they’ve viewed specific types of content.</p>
<p>Hmmm…a real humdinger!</p>
<h3>Test &amp; Target to the rescue</h3>
<p>It gets a bit tricky to do, so I’ll do my best to explain it.</p>
<p>Before I do though, here’s an illustration of what was actually created.  Each of the rectangles with the little red circles is a separate Test &amp; Target campaign.  You’ll see there are 11 of them.  The final bottom row is content…you’ll see there are 12 of them.  And you might also notice a total of 10 nested mboxes!</p>
<p><a href="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/05/PGUG-Campaign-Web-Overview.png"><img style="background-image: none; padding-left: 0px; padding-right: 0px; display: inline; padding-top: 0px; border-width: 0px;" title="PGUG Campaign Web Overview" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/05/PGUG-Campaign-Web-Overview_thumb.png" border="0" alt="PGUG Campaign Web Overview" width="644" height="305" /></a></p>
<p>In a bit more detail, we’ve ended up with:</p>
<ul>
<li>1 primary campaign as a Landing Page campaign that switches between an UG or PG experience, with a default offer for those we know nothing about.  The UG or PG experience then calls on (via a nested mbox):</li>
<li>1 of the 2 recruitment campaigns (UG or PG) as Landing Page campaigns so we can target one of the four  stages of the application, via nested mboxes, which calls on:</li>
<li>1 of the 8 A/B..n campaigns to determine the offer displayed</li>
</ul>
<p>There’s a total of:</p>
<ul>
<li>10 nested mbox offers…</li>
<li>12 content offers (the things people actually end up seeing)…</li>
<li>5 expression targets…</li>
<li>And 6 profile targets…</li>
</ul>
<p>Holy moly, I can hear you say.  Why so complicated?  It’s complicated because of the need to switch people between the campaigns based on what content and stage they’re at.</p>
<h3>So, how does it all work?</h3>
<h4>The top campaign:</h4>
<p>As we want to target initially by user interest (they’ve previously viewed Undergrad or Postgrad content, or they’ve visited an Undergrad or Postgrad course, or they’ve visited the Undergrad microsite or Postgrad site, or they’ve come in from an Undergrad of Postgrad email campaign, or they’ve visited the Figure Out Your Course tool or the Postgrad tool), we need to be able to get them into the relevant Undergrad or Postgrad campaign.</p>
<p>So, we need to use a Landing Page Campaign, which is set to re-evaluate the rules (and hence the offers) each time it displays.  This allows a user to see different experiences each time, based on the rules above.  It’ll switch a user to the opposite campaign if they go, say, from an Undergrad course to a Postgrad course.</p>
<p>But, we don’t want to show them an offer just yet.  We’re only doing this to determine which campaign they need to get into – and change that decision on the fly.</p>
<h3>Hello nested mbox</h3>
<p>On our home page, we already have an mbox (marketing box) defined, with default content.  So we start off by creating a campaign to use that mbox.</p>
<p>The following shows the top level campaign, targeting the default mbox on the page – HP_lowerleft.</p>
<p><a href="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/05/top_level_campaign.png"><img style="background-image: none; padding-left: 0px; padding-right: 0px; display: inline; padding-top: 0px; border-width: 0px;" title="top_level_campaign" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/05/top_level_campaign_thumb.png" border="0" alt="top_level_campaign" width="644" height="436" /></a></p>
<p>Instead of serving content back, we want to serve back a different campaign (Undergrad or Postgrad), so we actually need to serve back a nested mbox as our offer.</p>
<p>A nested mbox is just an mbox served into an existing mbox, which then makes another call to Test &amp; Target to get more content.</p>
<p>So, if I meet the criteria for Undergrad, then the content offer that Test &amp; Target serves back to me contains a new mbox.  The content offer looks like:</p>
<p><code>&lt;div class="mboxDefault"&gt;<br />
&lt;/div&gt;<br />
&lt;script type="text/javascript"&gt;<br />
mboxCreate('UndergradNested');<br />
&lt;/script&gt;</code></p>
<p>I repeat that type of content offer for the Postgrad campaign offer, but call the other mbox ‘PostgradNested’.</p>
<p>From a conversion standpoint, we set the Conversion as an SiteCatalyst:event…meaning that whatever the user does, the campaign thinks they’ve converted, and as they restart with the same experience, it re-evaluates them each time, to determine which offer to show them.</p>
<p>That’s campaign #1.</p>
<p>We’ll call it the Mid Year Parent Campaign – and it’s the one at the very top of the illustration.</p>
<p>Now that I have that, I need to create two sub campaigns; one for Undergrad, the other for Postgrad. These campaigns will serve something back into the UndergradNested mbox, or the PostgradNested mbox.</p>
<h3>Main Sub Campaigns</h3>
<p>So, as I also want to serve back behaviorally targeted content, based on their stage of application, I need to repeat the above type of scenario, but have the experiences based on the users stage.</p>
<h3>Stage of application</h3>
<p>Once again, a Landing Page campaign allows a user to see different experiences each time, based on the rules evaluated.</p>
<p>So, we created another Landing Page campaign, with 4 offers, each offer targeting the stage that the user has completed:</p>
<ol>
<li>They’ve started an application but haven’t completed it yet</li>
<li>They’ve qualified for entry, but haven’t started an application yet</li>
<li>They’re a repeat visitor and haven’t qualified yet</li>
<li>They’re a new visitor and haven’t qualified yet</li>
</ol>
<p><a href="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/05/undergrad_campaign.png"><img style="background-image: none; padding-left: 0px; padding-right: 0px; display: inline; padding-top: 0px; border-width: 0px;" title="undergrad_campaign" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/05/undergrad_campaign_thumb.png" border="0" alt="undergrad_campaign" width="644" height="430" /></a></p>
<p>But, again, we don’t want to show them an offer just yet – we want to show an A/B test for offers 3 &amp; 4, and different content for offers 1 &amp; 2.  So, again, we serve back a nested mbox offer, that aligns with the users stage.  In the example below, I’ve shown the nested mbox content for Experience D:</p>
<p><code>&lt;div class="mboxDefault"&gt;<br />
&lt;/div&gt;<br />
&lt;script type="text/javascript"&gt;<br />
mboxCreate('1stTimeVisNested');<br />
&lt;/script&gt;</code></p>
<h3>A/B..n Sub-Campaigns</h3>
<p>Now that I have the Undergrad main behaviorally targeted campaign created, I need to create the 4 sub-campaigns which will serve back real content that the user will see.</p>
<p>So, I create a new A/B..N campaign, target the mbox 1stTimeVisNested created above, and create 2 different experiences for it.  That’s the A/B test for the 1st Time Visitors who haven’t qualified.</p>
<p><a href="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/05/ab_test_1.png"><img style="background-image: none; padding-left: 0px; padding-right: 0px; display: inline; padding-top: 0px; border-width: 0px;" title="ab_test_1" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/05/ab_test_1_thumb.png" border="0" alt="ab_test_1" width="644" height="407" /></a></p>
<p>I repeat that for Repeat Visitors who haven’t qualified, but this time I target the campaign at the mbox RepeatVistNested.  This one also has two offers (the A/B test for this campaign).</p>
<p>Then I create two more A/B campaigns which will serve back content into the respective mbox defined during the other two stages of the application.</p>
<p>Complicated I know – hope you’re still with me.</p>
<h3>Rinse and Repeat</h3>
<p>Once all that’s been created, it’s a fairly simple matter to duplicate each campaign for a Postgrad version, modify the offer to create new distinct mboxes for each one, and set up the A/B campaigns, with their respective offers.</p>
<p>In doing so, we now have a total of 11 campaigns and 10 nested mboxes, with 12 content offers.</p>
<p>Now to the targeting of it all.</p>
<h3>Targeting Expressions and Profiles</h3>
<p>Interestingly, this turned out to be the hardest part.</p>
<p>The very first campaign needs to determine whether to ultimately display Undergrad content or Postgrad content.</p>
<p>So, as we have OR’s in our rules, we need to use an Expression Target (basically Javascript that sits in the T&amp;T target rules and returns a true or false).  We have to use an expression because the rules at the campaign level are all AND-based rules…which don’t work for us.</p>
<p>So, we have two Expression Targets on the main top level campaign…one to determine Postgrad the other to determine Undergrad.</p>
<p><a href="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/05/top_level_target1.png"><img style="background-image: none; padding-left: 0px; padding-right: 0px; display: inline; padding-top: 0px; border-width: 0px;" title="top_level_target" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/05/top_level_target_thumb1.png" border="0" alt="top_level_target" width="644" height="228" /></a></p>
<p>By way of explanation, the Undergrad target expression basically says:</p>
<p>1) Get the value of the last campaign that the user clicked on (that’s our campaign tags)<br />
2) Return true if the users last:<br />
a) coursecategory was Undergrad, or<br />
b) tool used was Mid Year, or<br />
c) LastMicrosite visited was Undergrad, or<br />
d) campaign tag contained “undgrad”, or<br />
e) the current URL query string contains a special one for us to test it with!</p>
<p>The same is basically true for the Postgrad target, just different values.</p>
<p>These two expression targets are then used in the campaign, highlighted below.  Despite the fact that it says “…is present”, what it actually means is “… is true”.  Never understood why that is, but there we go.</p>
<p><a href="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/05/top_level_campaign_targets.png"><img style="background-image: none; padding-left: 0px; padding-right: 0px; display: inline; padding-top: 0px; border-width: 0px;" title="top_level_campaign_targets" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/05/top_level_campaign_targets_thumb.png" border="0" alt="top_level_campaign_targets" width="537" height="484" /></a></p>
<p>Then we need to set up our Application Stage targeting – basically telling us if the user has Qualified for Entry and hasn’t started and app, or if they’ve started one but haven’t completed it yet.  So we added more targets as follows:</p>
<p><a href="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/05/stages_3_and_4_targets.png"><img style="background-image: none; padding-left: 0px; padding-right: 0px; display: inline; padding-top: 0px; border-width: 0px;" title="stages_3_and_4_targets" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/05/stages_3_and_4_targets_thumb.png" border="0" alt="stages_3_and_4_targets" width="644" height="201" /></a></p>
<p>You’ll notice in both that there are a combination of both user and profile based rules.  User rules are script based and are set up in the Profiles area of T&amp;T and profile based rules are values passed into T&amp;T from an mbox.</p>
<p>We use a lot of mboxes across the site and pass quite a few profile parameters in through the mboxes – which makes it easier for us to target later.  All of our key stages have been pre-tagged with mboxes and various parameters.</p>
<p>The only one to use a user-based profile is our lastcampaign profile.  Anytime a visitor comes to our site and the visit contains a campaign tracking code, the code is automatically passed into Test &amp; Target and saved into their user profile, via a script, shown below.</p>
<p><a href="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/05/user_profiles.png"><img style="background-image: none; padding-left: 0px; padding-right: 0px; display: inline; padding-top: 0px; border-width: 0px;" title="user_profiles" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/05/user_profiles_thumb.png" border="0" alt="user_profiles" width="644" height="256" /></a></p>
<p>You’ll also notice some of the profile.parameters that have been passed in – note that you can’t edit them.</p>
<p>In testing all of this, I just couldn’t figure out why I always ended up in the repeat visitor campaign for either UG or PG.</p>
<p>The reason was easy to overlook, and worth mentioning:</p>
<p>I’d actually structured the order of offers back to front in the second level campaigns…stupid me, I did know this, I clean forgot when I created the campaigns (Omniture: it would be great though to be able to re-order experiences – but you can’t you have to delete and start again).  The reason being, you have to put the highly targeted ones at the top and the broadest match at the bottom, as T&amp;T evaluates in the order that the experiences are displayed.  And thanks to Veronica at Omniture for spotting a misplaced apostrophe…they’ll get you everytime!</p>
<h3>Testing everything</h3>
<p>Yes, it’s a challenge – this many campaigns and offers means lots of new sessions, clearing of cookies, and re-establishing the stage of the user journey, but after a few hours, confirmation was established that everything was as it should be.</p>
<p>The biggest problem was that as we were serving back nested mboxes, we couldn’t preview the content in-situ as you would normally do through On-Site Preview, as it looks for the mbox on the page…and they don’t “exist” yet because they’ve not been served back yet.</p>
<p>But we go there.</p>
<h3>Performance?</h3>
<p>With all of these nested mboxes flying around, I was concerned by performance.  But, I was really happily surprised…it’s virtually undetectable.  Using WASP we’re able to see the order that the mboxes are served in and they match up correctly.</p>
<p><a href="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/05/mbox_calls_WASP.png"><img style="background-image: none; padding-left: 0px; padding-right: 0px; display: inline; padding-top: 0px; border-width: 0px;" title="mbox_calls_WASP" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/05/mbox_calls_WASP_thumb.png" border="0" alt="mbox_calls_WASP" width="563" height="849" /></a></p>
<h3>In Summary</h3>
<p>So, there we have it.  Two behaviorally targeted campaigns, with triple backflip A/B twists thrown in.  The horse is back in the stable, the gates of hell are securely closed again and Rapture didn’t happen.</p>
<p>Test &amp; Target came to the rescue and allows us to do what we need to do from a campaign standpoint.</p>
<p>I can sleep now – the campaign is live, you can experience the different offers by viewing the homepage, then a Postgrad course, then an Undergrad course, then repeating your visit later, or starting an app and not completing it.  If you feel so inclined…</p>
]]></content:encoded>
			<wfw:commentRss>http://www.elephantsandanalytics.com.au/blogposts/test-and-target-silly-season-has-arrived/feed/</wfw:commentRss>
		<slash:comments>3</slash:comments>
		</item>
		<item>
		<title>Moving beyond business-based segmentation</title>
		<link>http://www.elephantsandanalytics.com.au/blogposts/moving-beyond-business-based-segmentation/</link>
		<comments>http://www.elephantsandanalytics.com.au/blogposts/moving-beyond-business-based-segmentation/#comments</comments>
		<pubDate>Wed, 20 Apr 2011 10:48:23 +0000</pubDate>
		<dc:creator>Tim Elleston</dc:creator>
				<category><![CDATA[SiteCatalyst]]></category>
		<category><![CDATA[behavioural targeting]]></category>
		<category><![CDATA[Conversions]]></category>
		<category><![CDATA[Discover]]></category>
		<category><![CDATA[saint]]></category>
		<category><![CDATA[Segmentation]]></category>
		<category><![CDATA[Test&Target]]></category>

		<guid isPermaLink="false">http://www.elephantsandanalytics.com.au/blogposts/moving-beyond-business-based-segmentation/</guid>
		<description><![CDATA[<a href="http://www.elephantsandanalytics.com.au/blogposts/moving-beyond-business-based-segmentation/"><img align="left" hspace="5" width="75" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/04/FOYL_Dashboard.png" class="alignleft wp-post-image tfe" alt="FOYL_Dashboard" title="FOYL_Dashboard" /></a>One of the most powerful ways to enable an audience connection is through behavioural segmentation.

Many companies today segment from a business standpoint.  Don’t get me wrong, this is a good strategy and aligns your measurement and optimisation strategy with your business segmentation model.

Customer / non-customer segments.  Product A owners / product B owners.  Mosaic-based segments.  Geographic segments.  Lead / Non-lead segments.  These are all typically business-based segments, and you should definitely be segmenting using this methodology if your overall business does.

But I think there’s a higher level of segmentation – behavioural segmentation.  Read on to see how we easily achieved this.

]]></description>
			<content:encoded><![CDATA[<div class="tweetmeme_button" style="float: right; margin-left: 10px;">
			<a href="http://api.tweetmeme.com/share?url=http%3A%2F%2Fwww.elephantsandanalytics.com.au%2Fblogposts%2Fmoving-beyond-business-based-segmentation%2F"><br />
				<img src="http://api.tweetmeme.com/imagebutton.gif?url=http%3A%2F%2Fwww.elephantsandanalytics.com.au%2Fblogposts%2Fmoving-beyond-business-based-segmentation%2F&amp;source=timelleston&amp;style=normal&amp;b=2" height="61" width="50" /><br />
			</a>
		</div>
<p><img style="background-image: none; border-right-width: 0px; padding-left: 0px; padding-right: 0px; display: inline; float: right; border-top-width: 0px; border-bottom-width: 0px; border-left-width: 0px; padding-top: 0px" title="FOYL_Dashboard" border="0" alt="FOYL_Dashboard" align="right" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/04/FOYL_Dashboard.png" width="244" height="144" />One of the most powerful ways to enable an audience connection is through behavioural segmentation.</p>
<p>Many companies today segment from a business standpoint.&#160; Don’t get me wrong, this is a good strategy and aligns your measurement and optimisation strategy with your business segmentation model.</p>
<p>Customer / non-customer segments.&#160; Product A owners / product B owners.&#160; Mosaic-based segments.&#160; Geographic segments.&#160; Lead / Non-lead segments.&#160; These are all typically business-based segments, and you should definitely be segmenting using this methodology if your overall business does.</p>
<p>But I think there’s a higher level of segmentation – behavioural segmentation.</p>
<h3>Behavioural segmentation in action</h3>
<p>Every time someone visits your site they’re telling you what they’re interested in.&#160; These behavioural segments are measurable and usable.&#160; And moving from business-based segmentation to behavioural segmentation truly allows you to relevantly engage with your customers based on what they’ve told you about themselves, through either their activity on your site, or through forms they’ve completed.</p>
<p>At Murdoch, we recently re-developed our primary lead generation tool, called “Figure Out Your Life”.</p>
<p>FOYL, as it was affectionately known to us, was the University’s primary lead gen tool – it essentially asks you a number of questions and then suggests courses or careers that may be of interest to you.</p>
<p>Overall, the redesign was based on user feedback from focus groups but we took the opportunity to introduce behavioural segmentation into it, to not only measure those segments over time, using a combination of SiteCatalyst and SAINT classifications, but to enable more refined and relevant content targeting to each segment for optimisation and engagement purposes.</p>
<p>The new FOYL, now called <a href="http://www.murdoch.edu.au/Future-students/Figure-out-your-course/?cid=elephant" target="_blank">Figure Out Your Course</a> (or FOYC) asks 6 personality-type questions, and allows the user to rate their answer to each question, on a sliding scale, from 1 to 10.</p>
<p>The combination of their answers to the 6 questions results in 3 recommendations for courses they might consider.&#160;&#160; </p>
<p>I’m not going to reveal the methodology behind tool – that’s confidential IP and very complex, but I will talk about the segmentation opportunities it allows.</p>
<h3>How we achieved behavioural segmentation</h3>
<p>From a segmentation standpoint, we decided that we wanted to firstly measure the segments to see what “types” of users are completing the tool, and secondly, through integration with Test &amp; Target, we can then customise content to each user, based on how they answered each question.</p>
<p>To do so, we needed to capture each of their answers in an eVar (conversion variable), which must be remembered over multiple visits.</p>
<p>To enable more realistic clustering of segments, we decided that while the tool works on a rating between 1 and 10, we’d actually work our segments on a rating of 1 to 5.&#160; So we “bucketed” each answer accordingly:</p>
<p>Moving the slider to position 1 or 2 makes them segment 1,    <br />3 or 4, segment 2     <br />5 or 6, segment 3     <br />7 or 8, segment 4     <br />9 or 10, segment 5</p>
<p>In doing so, each user now scores (from a segment standpoint) between 111111 and 555555, which makes a total of 15,625 combinations (111111, 111112, 111113, etc through to 555555), or 5^6.</p>
<p>By combining their scores for individual answers into a single variable, we end up with a per-person score, where each digit in the variable represents their chosen response to each question.&#160; </p>
<p>So for example, if a person answers question 1 with a rating of 2, question 2 a rating of 10, question 3 a rating of 7, question 4 a rating of 10, question 5 a rating of 6 and question 6 a rating of 1, their overall segment score would be 154531.</p>
<p>We store this in an eVar and a persistent s.prop, and pass them to SiteCatalyst.</p>
<h3>Results</h3>
<p>What we end up with is a list of scores in a SiteCatalyst report as follows:</p>
<p><a href="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/04/FOYL_segments_raw.png"><img style="background-image: none; border-right-width: 0px; padding-left: 0px; padding-right: 0px; display: inline; border-top-width: 0px; border-bottom-width: 0px; border-left-width: 0px; padding-top: 0px" title="FOYL_segments_raw" border="0" alt="FOYL_segments_raw" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/04/FOYL_segments_raw_thumb.png" width="266" height="239" /></a></p>
<p>Not a lot of use, except that we can see the raw scores and the number of instances of each score.&#160; You can see as well that they’ve started to cluster.&#160; 50 people have been through the tool and selected 141515 as their answers to each question.</p>
<p>Using SAINT classifications, we then created every possible combination and classified every result.&#160; Despite it being 15,625 combinations, this only took a few minutes – gotta love Excel for this.</p>
<p>We’ve classified each digit location as the question, and each digit value as the score from 1 to 5.</p>
<p>For example, the classification for digit location 1 is “Indoors (1) or Outdoors (5)”.&#160; The values range from 1 to 5.</p>
<p>Our classification file looks like:</p>
<p><a href="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/04/FOYL_Classification_File.png"><img style="background-image: none; border-bottom: 0px; border-left: 0px; padding-left: 0px; padding-right: 0px; display: inline; border-top: 0px; border-right: 0px; padding-top: 0px" title="FOYL_Classification_File" border="0" alt="FOYL_Classification_File" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/04/FOYL_Classification_File_thumb.png" width="644" height="350" /></a></p>
<p>We set “No FOYL” as the default for people who haven’t been through the tool yet – which also allows us to use T&amp;T to engage them into the tool.</p>
<p>Using the classifications, we can now see a report that shows all responses to digit location 1…i.e. how did people answer that question:</p>
<p><a href="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/04/FOYL_Question_1_Responses.png"><img style="background-image: none; border-right-width: 0px; padding-left: 0px; padding-right: 0px; display: inline; border-top-width: 0px; border-bottom-width: 0px; border-left-width: 0px; padding-top: 0px" title="FOYL_Question_1_Responses" border="0" alt="FOYL_Question_1_Responses" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/04/FOYL_Question_1_Responses_thumb.png" width="361" height="182" /></a></p>
<p>So we can see that most people are answering question 1 with a segment rating of 3 (mid way).&#160; Unfortunately, we can’t order the values numerically, they are ordered highest to lowest on their instances.</p>
<p>If we chart that as a pie chart, we see:</p>
<p><a href="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/04/FOYL_Question_1_Pie.png"><img style="background-image: none; border-right-width: 0px; padding-left: 0px; padding-right: 0px; display: inline; border-top-width: 0px; border-bottom-width: 0px; border-left-width: 0px; padding-top: 0px" title="FOYL_Question_1_Pie" border="0" alt="FOYL_Question_1_Pie" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/04/FOYL_Question_1_Pie_thumb.png" width="419" height="209" /></a></p>
<p>Now we repeat that for every question asked and pop it into a dashboard for an overview of results, and we can see:</p>
<p><a href="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/04/FOYL_Dashboard1.png"><img style="background-image: none; border-right-width: 0px; padding-left: 0px; padding-right: 0px; display: inline; border-top-width: 0px; border-bottom-width: 0px; border-left-width: 0px; padding-top: 0px" title="FOYL_Dashboard" border="0" alt="FOYL_Dashboard" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/04/FOYL_Dashboard_thumb.png" width="644" height="377" /></a></p>
<p>We can also now sub-relate those individual segments with the courses they’ve viewed:</p>
<p><a href="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/04/FOYL_Question_1_Courses.png"><img style="background-image: none; border-right-width: 0px; padding-left: 0px; padding-right: 0px; display: inline; border-top-width: 0px; border-bottom-width: 0px; border-left-width: 0px; padding-top: 0px" title="FOYL_Question_1_Courses" border="0" alt="FOYL_Question_1_Courses" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/04/FOYL_Question_1_Courses_thumb.png" width="644" height="372" /></a></p>
<p>Our true measure by segment is lead generation, so we just add in those conversion metrics too, Lead Start and Lead Complete and we can see conversion by segment.</p>
<h3>Discover</h3>
<p>Using Discover, we can create those segments individually and compare them.&#160; Here I’ve compared search terms against anyone that answered the Behind Scenes/Lead a team or Indoors/Outdoors with a 5:</p>
<p><a href="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/04/FOYL_Discover.png"><img style="background-image: none; border-right-width: 0px; padding-left: 0px; padding-right: 0px; display: inline; border-top-width: 0px; border-bottom-width: 0px; border-left-width: 0px; padding-top: 0px" title="FOYL_Discover" border="0" alt="FOYL_Discover" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2011/04/FOYL_Discover_thumb.png" width="644" height="144" /></a></p>
<p>The same segment can be used in SiteCatalyst 15 to segment your reports.</p>
<p>We also pass these segments into our email marketing platform so we can segment our ongoing communications further, generating a more personalised and relevant experience for the user.&#160; We can now customise parts of the message dynamically, based on the segment (or segments) that they told us they’re in.</p>
<h3>Test &amp; Target</h3>
<p>Now the really useful stuff.</p>
<p>Because Test &amp; Target can also see those segments and values, we can target content to each segment as they re-engage across our content.&#160; For example, we can vary messaging to people who prefer to work outdoors instead of indoors.</p>
<p>We can target course content to them based on their selections.</p>
<p>We can build multiple targets and combination targets to get the content to them.&#160; If they haven’t been through the tool, we’d also know that too, and we can target messaging to try to engage them that way.</p>
<h3>In summary</h3>
<p>Every company has the opportunity to segment. And that’s how you move beyond reporting to insight.&#160; Understanding how your segments interact with your content or how they convert differently allows you to further optimise their experience.&#160; </p>
<p>There’s plenty of opportunity to segment for measurement purposes, but when you combine Test &amp; Target with those segments, and start to target information based on those segments, it’s really powerful.</p>
<p>When you move away from just reporting, to segmentation, and beyond to segmentation based on user behaviour, you can really start to generate user engagement and relevance of content.</p>
<p>You just need to open your mind to the segmentation possibilities and find out what works for you.</p>
<p>Let me know how you’re segmenting your site visitors and what you’re doing around optimising their user journey based on their segments.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.elephantsandanalytics.com.au/blogposts/moving-beyond-business-based-segmentation/feed/</wfw:commentRss>
		<slash:comments>1</slash:comments>
		</item>
		<item>
		<title>Driving content relevance with Test&amp;Target</title>
		<link>http://www.elephantsandanalytics.com.au/blogposts/driving-content-relevance-with-test-and-target/</link>
		<comments>http://www.elephantsandanalytics.com.au/blogposts/driving-content-relevance-with-test-and-target/#comments</comments>
		<pubDate>Wed, 21 Oct 2009 09:38:33 +0000</pubDate>
		<dc:creator>Tim Elleston</dc:creator>
				<category><![CDATA[Test&Target]]></category>
		<category><![CDATA[behavioural targeting]]></category>
		<category><![CDATA[campaigns]]></category>
		<category><![CDATA[content relevance]]></category>
		<category><![CDATA[Segmentation]]></category>
		<category><![CDATA[strategy]]></category>
		<category><![CDATA[web analytics strategy]]></category>

		<guid isPermaLink="false">http://www.elephantsandanalytics.com.au/?p=148</guid>
		<description><![CDATA[<a href="http://www.elephantsandanalytics.com.au/blogposts/driving-content-relevance-with-test-and-target/"><img align="left" hspace="5" width="75" height="75" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2009/10/TandT-150x150.jpg" class="alignleft wp-post-image tfe" alt="Test and Target modules" title="Test and Target modules" /></a>In many cases homepages are either relatively static, or promotional driven.  The problem is that homepages are often still the starting point of a users journey on the site and not every user should see the same content.

Enter Omniture Test and Target.  A very powerful application that can dynamically change content based on previous user behaviors.  Content relevance yields greater conversion, so it makes a lot of sense to include it in your overall online strategy.  ]]></description>
			<content:encoded><![CDATA[<div class="tweetmeme_button" style="float: right; margin-left: 10px;">
			<a href="http://api.tweetmeme.com/share?url=http%3A%2F%2Fwww.elephantsandanalytics.com.au%2Fblogposts%2Fdriving-content-relevance-with-test-and-target%2F"><br />
				<img src="http://api.tweetmeme.com/imagebutton.gif?url=http%3A%2F%2Fwww.elephantsandanalytics.com.au%2Fblogposts%2Fdriving-content-relevance-with-test-and-target%2F&amp;source=timelleston&amp;style=normal&amp;b=2" height="61" width="50" /><br />
			</a>
		</div>
<div id="_mcePaste" style="position: absolute; left: -10000px; top: 0px; width: 1px; height: 1px; overflow-x: hidden; overflow-y: hidden;">Driving content relevance with Omniture Test and Target</div>
<div id="_mcePaste" style="position: absolute; left: -10000px; top: 0px; width: 1px; height: 1px; overflow-x: hidden; overflow-y: hidden;">In many cases homepages are either relatively static, or promotional driven.  The problem is that homepages are often still the starting point of a users journey on the site.</div>
<div id="_mcePaste" style="position: absolute; left: -10000px; top: 0px; width: 1px; height: 1px; overflow-x: hidden; overflow-y: hidden;">In our case, at Murdoch University, despite the fact that we use SEO and SEM tactics to drive clicks to deeper content, we know from our metrics that many users either bookmark our homepage, or search for &#8220;Murdoch University&#8221; or a derivative thereof, which means that they click through to our homepage.</div>
<div id="_mcePaste" style="position: absolute; left: -10000px; top: 0px; width: 1px; height: 1px; overflow-x: hidden; overflow-y: hidden;">The role of the homepage is to channel users into areas of the site as quickly as possible.  With many different audience groups, numerous campaigns, and many stakeholders, real estate is highly sought after.  So it&#8217;s crucial that we are able to address content relevance &#8211; make the content on the homepage as relevant to what the user is looking for when they visit.</div>
<div id="_mcePaste" style="position: absolute; left: -10000px; top: 0px; width: 1px; height: 1px; overflow-x: hidden; overflow-y: hidden;">Enter Omniture Test and Target.</div>
<div id="_mcePaste" style="position: absolute; left: -10000px; top: 0px; width: 1px; height: 1px; overflow-x: hidden; overflow-y: hidden;">Using Test and Target, we&#8217;re able to easily modify the content displayed on the homepage (and many other areas of the site), by using their sophisticated behvioural targeting technology, thereby making our content far more relevant to users when they visit, with the goal of optimizing their experience, and ultimately leading to more sales.</div>
<div id="_mcePaste" style="position: absolute; left: -10000px; top: 0px; width: 1px; height: 1px; overflow-x: hidden; overflow-y: hidden;">For example, if a user has previously been to our site, started an application but not yet completed it, why point them to the content that talks about how to apply, when you can prompt them to complete their application.</div>
<div id="_mcePaste" style="position: absolute; left: -10000px; top: 0px; width: 1px; height: 1px; overflow-x: hidden; overflow-y: hidden;">Likewise, if they have expressed an interest in a certain category of information, get them back into that stream with as few clicks as possible.</div>
<div id="_mcePaste" style="position: absolute; left: -10000px; top: 0px; width: 1px; height: 1px; overflow-x: hidden; overflow-y: hidden;">As Test and Target stores a profile of an individuals browsing activity on our site, coupled with SiteCatalyst data, and various parameters that we set on specific events throughout our site, we can use that as a kind of category or activity affinity, and alter content display based on those parameters, on a user by user basis.</div>
<div id="_mcePaste" style="position: absolute; left: -10000px; top: 0px; width: 1px; height: 1px; overflow-x: hidden; overflow-y: hidden;">For example, our homepage has 4 key modules on it.  Currently the two left modules are T&amp;T driven.  The left hand module is promotional based.  So we&#8217;re currently running a Postgraduate promotion.  If the user has been to a PostGraduate course previously, they will see the PostGraduate promotion.  If they have been to an Undergraduate course, they&#8217;ll see our Course Search module.</div>
<div id="_mcePaste" style="position: absolute; left: -10000px; top: 0px; width: 1px; height: 1px; overflow-x: hidden; overflow-y: hidden;">For the next module, it shows either a Future Students module (default), a Domestic Students module, or an International Students module.  If the user has been into the Domestic Students section, then in the future, when they see the homepage, they&#8217;ll see the Domestic module.  Likewise, if they are an International visitor, or they visit the International section, they&#8217;ll see the International module.  If we know nothing about them, i.e. they are within Australia but havent been to the site before, they&#8217;ll see the Future Students module.</div>
<div id="_mcePaste" style="position: absolute; left: -10000px; top: 0px; width: 1px; height: 1px; overflow-x: hidden; overflow-y: hidden;">Implementing Test and Target in this manner is very easy.  There are a number of key parts:</div>
<div id="_mcePaste" style="position: absolute; left: -10000px; top: 0px; width: 1px; height: 1px; overflow-x: hidden; overflow-y: hidden;">1) Put the code onto the page in the area where you want to display the content &#8211; this code is called an mbox.  It&#8217;s a combination of a &lt;div&gt; tag and a piece of javascript.</div>
<div id="_mcePaste" style="position: absolute; left: -10000px; top: 0px; width: 1px; height: 1px; overflow-x: hidden; overflow-y: hidden;">2) Put some default content inside the &lt;div&gt; tag.  This is displayed is nothing else can be displayed.  For us, the Course Search and the Future Students content is default.</div>
<div id="_mcePaste" style="position: absolute; left: -10000px; top: 0px; width: 1px; height: 1px; overflow-x: hidden; overflow-y: hidden;">3) Put mbox code onto other key pages and set specific parameters within those mboxes.  I call these &#8220;listeners&#8221; &#8211; they dont actually display any content, they just pass critical information into the users profile when they are activated, such as on key pages, or key events like starting or completing an application.</div>
<div id="_mcePaste" style="position: absolute; left: -10000px; top: 0px; width: 1px; height: 1px; overflow-x: hidden; overflow-y: hidden;">4) Put some alternative content into Test and Target.</div>
<div id="_mcePaste" style="position: absolute; left: -10000px; top: 0px; width: 1px; height: 1px; overflow-x: hidden; overflow-y: hidden;">5) Create targeted campaigns in Test and Target with rules about what content should be displayed (either default or content in step 4).</div>
<div id="_mcePaste" style="position: absolute; left: -10000px; top: 0px; width: 1px; height: 1px; overflow-x: hidden; overflow-y: hidden;">6) Activate the campaign and hey presto &#8211; behavioural targeting now works for you.</div>
<div id="_mcePaste" style="position: absolute; left: -10000px; top: 0px; width: 1px; height: 1px; overflow-x: hidden; overflow-y: hidden;">Ok, well, there might be a bit missing, like your content and targeting strategy, but you get the drift.</div>
<p>In many cases homepages are either relatively static, or promotional driven.  The problem is that homepages are often still the starting point of a users journey on the site and not every user should see the same content.</p>
<p>In our case, at Murdoch University, despite the fact that we use SEO and SEM tactics to drive clicks to deeper content, we know from our metrics that many users either bookmark our homepage, or search for &#8220;Murdoch University&#8221; or a derivative thereof, which means that they click through to our homepage.</p>
<p>The role of the homepage is to channel users into areas of the site as quickly as possible.  With many different audience groups, numerous campaigns, and many stakeholders, real estate is highly sought after.  So it&#8217;s crucial that we are able to address content relevance &#8211; make the content on the homepage as relevant to what the user is looking for when they visit, because relevance yields greater conversion.</p>
<h3>Enter Omniture Test and Target.</h3>
<p>Using <a href="http://www.omniture.com/en/products/conversion/testandtarget" target="_blank">Test and Target</a>, we&#8217;re able to easily modify the content displayed on the homepage (and many other areas of the site), by using their sophisticated behavioral targeting technology, thereby making our content far more relevant to users when they visit, with the goal of optimizing their experience, and ultimately leading to more sales.</p>
<p>For example, if a user has previously been to our site, started an application but not yet completed it, why point them to the content that talks about how to apply, when you can prompt them to complete their application.</p>
<p>Likewise, if they have expressed an interest in a certain category of information, get them back into that stream with as few clicks as possible.</p>
<p>As Test and Target stores a profile of an individuals browsing activity on our site, coupled with SiteCatalyst data, and various parameters that we set on specific events throughout our site, we can use that as a kind of category or activity affinity, and alter content display based on those parameters, on a user by user basis.</p>
<p><img class="aligncenter size-full wp-image-153" title="Test and Target modules" src="http://www.elephantsandanalytics.com.au/wp-content/uploads/2009/10/TandT.jpg" alt="Test and Target modules" width="500" height="271" /></p>
<p>For example, <a href="http://www.murdoch.edu.au" target="_blank">our homepage</a> has 4 key modules on it.  Currently the two left modules are T&amp;T driven.  The left hand module is promotional based.  So we&#8217;re currently running a Postgraduate promotion.  If the user has been to a PostGraduate course previously, they will see the PostGraduate promotion.  If they have been to an Undergraduate course, they&#8217;ll see our Course Search module.</p>
<p>For the next module, it shows either a Future Students module (default), a Domestic Students module, or an International Students module.  If the user has been into the <a href="http://www.murdoch.edu.au/Future-students/Domestic-students/" target="_blank">Domestic Students</a> section, then in the future, when they see the <a href="http://www.murdoch.edu.au/" target="_blank">homepage</a>, they&#8217;ll see the Domestic module.  Likewise, if they are an International visitor, or they visit the <a href="http://www.murdoch.edu.au/Future-students/International-students/" target="_blank">International section</a>, when they see the <a href="http://www.murdoch.edu.au/" target="_blank">homepage</a>, they&#8217;ll see the International module.  If we know nothing about them, i.e. they are within Australia but haven&#8217;t been to the site before, they&#8217;ll see the Future Students module.</p>
<p>Implementing Test and Target in this manner is very easy.  There are a number of key parts:</p>
<ol>
<li>Put the code onto the page in the area where you want to display the content &#8211; this code is called an mbox.  It&#8217;s a combination of a &lt;div&gt; tag and a piece of javascript.</li>
<li>Put some default content inside the &lt;div&gt; tag.  This is displayed is nothing else can be displayed.  For us, the Course Search and the Future Students content is default.</li>
<li>Put mbox code onto other key pages and set specific parameters within those mboxes.  I call these &#8220;listeners&#8221; &#8211; they don&#8217;t actually display any content, they just pass critical information into the user profile when they are activated, such as on key pages, or key events like starting or completing an application (see below).</li>
<li>Put some alternative content into Test and Target (called offers).</li>
<li>Create targeted campaigns in Test and Target with rules about what content should be displayed (either default or the content created in step 4).</li>
<li>Activate the campaign and hey presto &#8211; behavioural targeting now works for you.</li>
</ol>
<p>Ok, well, there might be a bit missing, like your content and targeting strategy, but you get the drift.</p>
<h3>Category and Activity Affinity</h3>
<p>Throughout our site, we pass a number of parameters through the &#8220;listener&#8221; mboxes, which are placed on strategic pages.  For example, in the above Domestic and International sections of the site, we have created a parameter called profile.sitesection and we pass in a value of either Domestic or International.  We can also pass in other values, such as &#8220;Research&#8221;, &#8220;Library&#8221;, &#8220;Student&#8221; or &#8220;Staff&#8221; on other pages, so that we can expand on the targeted content.  The strategy largely depends upon who</p>
<p>Our T&amp;T campaign that we created in step 5 then looks for either of those values and depending on the value, displays the relevant content.  If it doesn&#8217;t find a value, it serves the default content &#8211; the Future Students content.</p>
<p>Another area that we utilize this is within our online application system.  We pass in a value when they start an application and another when they complete an application.  This allows us to look for those values, and depending upon a combination of them, we know the status of an application (not started, started not completed, started and completed) and can then display relevant content to either engage them to start an app, prompt them to complete an app, or other default content.</p>
<p>Within T&amp;T we can also set conversion events.  These events are mostly used when you are testing different variations of promotions (I&#8217;ll post an entry about testing content in the near future) to see which one drives the best result.  For behavioral targeting we&#8217;ve found that we use these more for general reporting, rather than actual optimization.</p>
<h3>Practical usage ideas</h3>
<p>Content relevance is effective for every industry vertical.  For example:</p>
<ul>
<li><strong>ISP&#8217;s</strong> could use it to target content to customers with accounts, versus potential new customers.</li>
<li><strong>Banks</strong> could use it to target product category affinity &#8211; those that might have expressed an interest in mortgages versus credit cards.</li>
<li><strong>Retailers </strong>could use it to target product category affinity too &#8211; if a user expresses an interest in TV, show them TV products on the homepage over other products.</li>
<li><strong>Tourism </strong>operators could target by region of interest or by activity, such as kayaking, or fishing.</li>
<li><strong>Media companies</strong> could use it to display news from a certain category, for example, finance news over fashion news.</li>
</ul>
<p>One of the most successful strategies is re-engagement; get an abandoned user back into a process quickly.  You know they&#8217;ve abandoned; they&#8217;re back on your site; re-engage them and try to convert them.</p>
<p>Like everything though, it&#8217;s important that the content strategy is thought through first and the objectives and success measures are clearly defined, before trying to implement.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.elephantsandanalytics.com.au/blogposts/driving-content-relevance-with-test-and-target/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
	</channel>
</rss>

