Posted by Brian Roy on December 16, 2009 · View Comments
From our Founder’s Blog
From time to time our founder Brian Roy shares his observations about the state of Social Media, Social Media Analytics, tools and best practices (and any number of other topics) – and we share them here.
The consensus seems to be that creating an ROI for Social Media is hard. I’d like to suggest that it isn’t.
Formulating an ROI is a very simple formula – and until someone can rationally explain why Social Media is different I’ll get out my cookbook.
- Define the desired outcome (e.g., increase conversion rate by 3%).
- Define the specific actions that will be taken (e.g., offer specials via blog, Twitter and Facebook with specific landing pages).
- Define the metrics and measures that will be used to determine if the actions taken were the proximate cause of the result.
- Perform the actions and analyze the metrics and measures.
- Determine cost of actions and the value of the resultant change in the outcome.

The flaw in most approaches to Social Media ROI happens on the very first step. If you can’t assign real value to the desired outcome you can’t create an ROI. A perfect example is “We’d like to double our followers on Twitter and fans on Facebook”. Some people will call this a “soft ROI” – which is simply another way of saying that the desired outcome can not be assigned a real value, but affects another metric that can. The relationship between the desired outcome (more followers/fans) and the real value metric (sales) is usually highly theoretical – our just plain wishful thinking. If you believe more followers or fans equates to higher sales – say so. Design your ROI experiment and prove it.
The other flaw is in step 3. Failing to adequately define the input metrics (the metrics that are the proximate cause of the change in outcome) leads to an ROI that does not bear scrutiny. Examples of poorly defined input metrics are:
- Increase our Social Media Presence
- Get more engagement
- Have better sentiment about our brand
- Be influential in our space
Avoid those two traps and you’ll be well on your way. But there is one mistake I see more than any other:
Stop trying to create a “pure” or “standalone” Social Media ROI!!
Another way to put this – in terms of our recipe above – is:
If your desired outcome is a Social Media metric or measure – think again.
I’ll end the suspense for you right now, it doesn’t exist. The only way to ROI a Social Media effort is by showing that your Social Media effort is the proximate cause of a change in a fundamental business metric (e.g., sales, conversion rate, leads generated, churn, etc).
CRM is a great example of this – I was involved in dozens of large footprint CRM deployments. Well over half of those were done based on a solid ROI – but it had nothing to do with customers. The ROI was based purely on cost savings in IT. Do I believe those deployments had other benefits which were harder to measure and quantify? Sure. But the way to prove the investment had a return was to focus on what was proven, repeatable and tangible.
I think Social Media is much easier to ROI than CRM was. I don’t think we will end up creating ROI based on savings in IT. I am, however, certain that the ROI will have to point to real dollars saved or real dollars generated.
I’m convinced that when you focus on determining which Social Media metrics are the proximate cause of change in core business metrics you’ll find an ROI – and I’m betting it will be both larger and more diverse than you would have predicted.
Posted by Brian Roy on December 15, 2009 · View Comments
From our Founder’s Blog
From time to time our founder Brian Roy shares his observations about the state of Social Media, Social Media Analytics, tools and best practices (and any number of other topics) – and we share them here.
I’m honestly heartened by the sudden rash of efforts to create a methodology to determine ROI (return on investment) for Social Media efforts. It signals something very important for Social Media – the return of rationality to the debate.
When you consider that a few short months ago the prevailing meme was that creating a basis for your Social Media efforts in terms of ROI was “doing it wrong” – it is impressive how far we’ve come. The realization that moral arguments and scare tactics will only get you so far – and in many cases backfire – has led to an overwhelming need to create an ROI model.
Unfortunately many of these efforts are not really after ROI – they are seeking to justify an already formed point of view.
The reality is we simply don’t know if Social Media has a analytical, fact based ROI. That may sound odd coming from a guy who has bet his personal savings starting a Social Media Engagement and Analytics company – so let me explain both why the ROI hasn’t been proven and why I’m betting it will be.
Social Media is a Niche Opportunity – Today
If you want to know why there is no fact based proven ROI for Social Media investments today, all you need to understand is that Social Media has been adopted in niches. It may be in the Marketing department, or used by your Digital Agency, or perhaps in your Customer Service department. Each of these adoptions was driven out of fear (we have to monitor this and deal with the negative) or the moral (we love our customers – so we are going to do this). The investment was negligible – and in most cases I’d bet it was funded right out of the operating budget of the organization where it was used.
These organizations are beginning to declare victory and are being challenged to prove it. This presents unique challenges, because Social Media runs on anecdotes, not analysis. Dell sells 3 million in product from Dell Outlet after offering those products on Twitter. That is a great anecdote – but it isn’t analysis. When you ask the critical questions:
- What would you have sold without Twitter?
- Was that a 3MM increase in sales – or just 3MM net sales from those links?
- How much did it cost to generate the 3MM in sales and how does that compare to email?
- Is this repeatable – can it be replicated in other parts of the business – and how do you know?
you quickly find that the anecdote doesn’t equate to ROI. It might… but it isn’t there yet.
These types of anecdotes are justifications. They are about proving the correctness of an already made assumption.
I’ve seen this movie before – it exactly parallels the pattern for CRM in the late 1990′s.

NOTE: For simplicity I’ve omitted the case where a technology/methodology has a niche ROI without broader adoption.
We are squarely in the middle of the justification phase for Social Media. This roughly corresponds to the height of the expectations (the big peak on the Gartner Magic Quadrant) and always directly precedes the Trough of Disillusionment. This is a recognizable and predictable pattern for adoption of new technologies and methodologies – and here is why.
The initial opportunity is too good to stay on the sidelines for some early adopter group. They – almost always within existing operating budgets and using the promise as a bulwark defense – adopt the technology/methodology. Once they believe they have seen tangible results they attempt to socialize the “win” outside the organization by creating justifications for what they’ve already done. These justifications bring broader scrutiny.
That scrutiny happens in two phases:
- Was it worth it?
- Can it be done systemically – can I forecast a x% increase in metric z if I do this again.
The second is ROI. A systemic way of proving that adoption generates a return. If, and only if, that can be proven will the technology escape the niche application and be applied on a broad scale.
Why does it work this way – because enterprises are first and foremost risk management systems. They systemically avoid large risks.
Why Will Social Media Attain Broad Adoption
The primary reasons I believe Social Media will in fact generate a valid ROI and attain broad adoption:
- It is measurable.
- The unrecognized value far exceeds the recognized value.
Measurability
As you might imagine, it is very difficult to justify and create a systemic ROI for something that is exceptionally difficult to measure. Social Media is – in contrast – eminently measurable. Rational decisions must be made about what to measure – and we need more focus on connecting those measures to the core business metrics – but there is no fundamental barrier to creating valuable measures.
The Value Proposition
Today, we’ve put all our Social Media eggs in the PR/Marketing basket. Even the small amount of credibility given to customer service via Social Media has been driven by the (C-Level Down) idea that customer service should “avert disasters” by monitoring Social Media and addressing customer issues. Make no mistake, this is customer service acting in a PR role – the goal isn’t to provide service so much as to avoid negative perceptions.
However, if you take one large step back and think about the opportunity Social Media presents – you can quickly see that the value proposition is in having a huge, open back channel to your market. We’ve had channels to our customers, and sometimes even our prospects – but this is bigger. It is the entire market for your product or service. You get to listen in on what they have to say about what they want and need. You can engage them to better understand their motivations. You can apply what you learn to create incremental improvements in every phase of your business.
Yes, you can send out special offers. Yes, you can address customer concerns. But the real return will come from having a robust back channel with your entire market; and the resulting market intelligence can – if you apply it – help you make every part of your business more appealing to your target market.
So let’s get serious about ROI. Let’s talk about how companies operate and win by continually tuning their processes to better address the needs of their target market. Let’s talk about how Social Media provides them a back channel to that market, a back channel that is an invaluable source of intelligence about the market.
Let’s talk about how a business that applies the intelligence gained via Social Media to all of their decision making processes is faster and more agile in addressing the needs of their market – and thereby wins market share.
Posted by Brian Roy on December 14, 2009 · View Comments
Late last week we announced that our newest analytic – SignalLinks – had left beta and was rolled out to all justSignal accounts. You can learn more about the SignalLinks analytic here.
Today we wanted to let you know that we’ve added the metadata for SignalLinks to our API.
We generate tons of metadata – or data about the Social Media content we collect – to facilitate our analytics and because we dig statistical analysis. Much of the metadata we generate never appears in our base analytics.
One of the key features of justSignal is our commitment to actually implementing an open data policy. Our open data policy isn’t a paragraph in our Terms of Service, or a vague statement on our site – it is something we consistently implement.
In accordance with that principal we publish every scrap of metadata we generate via our API services. SignalLinks is an excellent example. When we designed the metadata generation for SignalLinks we designed for two key views:
- Links – Volume data about specific links (how many times was it mentioned).
- Users – Who is mentioning which links, how often, etc.
The user view has not yet been released as an analytic. When we designed the SignalLinks analytic we realized that the Links view contained so much information that it didn’t make sense to try to cram in Users view – we thought it would be too much and, frankly, a little confusing.
But just because we aren’t using it right now doesn’t mean you shouldn’t be able to you.
The API release today includes both the Links and Users views – every scrap of metadata we are generating.
SignalLinks – Links View
The Links View contains two sets of information:
- The top (up to) 100 mentioned links
- Number of Mentions
- Date (month, day, year)
- Original URL (probably shortened)
- End URL (The actual destination URL)
- Domain (The domain the URL points to i.e., google.com)
- Links Summary – a summary of the data for all mentioned links.
- Date (month, day, year)
- Total number of mentions (content containing a link)
- Number of distinct links found.
- Mean number of mentions
- Median number of mentions
- Standard Deviation number of mentions
SignalLinks – User View
The User View contains the same two information sets, but organized around the user mentioning the link (not the link itself).
- The top (up to) 100 users posting links (by number of links posted)
- Number of times the user mentioned the link.
- Date (month, day, year)
- Original URL (probably shortened)
- End URL (The actual destination URL)
- Domain (The domain the URL points to i.e., google.com)
- User
- Links Summary – a summary of the data for all mentioned links.
- Date (month, day, year)
- Total number of mentions (content containing a link)
- Number of users who mentioned a link.
- Mean number of times a user mentioned a link.
- Median number of times a user mentioned a link.
- Standard Deviation number of times a user mentioned a link.
This is a powerful dataset for analyzing the links found in your Signal. Combining this with information you probably already have (metrics measuring the number of hits on specific landing pages, conversion rates on landing pages, etc) will give you a powerful tool to understand how much the appearance of those links on Social Media sites drives both traffic and conversion.