Making Data Collection for Measurement Practical [AR Practitioner Question]

AR Metrics & MeasurementQuestion:  How do you make data collection easier for AR measurement programs?

This question gets to the heart of the measurement challenge-if it is too difficult to do, it will not get done.  Making data collection practical involves selecting the right mix of metrics, leveraging outside resources, and automating many tasks.

[This post focuses on the data collection aspects of an effective measurement program.  Therefore, the following related topics will not be addressed 1) picking and prioritizing the right metrics, 2) distinguishing between operational and performance metrics, and 3) using metrics to track performance against pre-defined goals.  For discussion of these topics, please see Online SageContentTM Library series “Metrics and Program Measurement.”]

SageCircle Technique:

  • Selecting the Right Mix of Metrics. First, to make data collection practical, you must pick metrics that meet measurement program goals (e.g. track what you want to measure) and are easy and cost-effective to generate (e.g. data collection requires moderate/minimal effort). Be clear on what you want to measure and collect only that data so you can encourage AR team participation. However, do not reject metrics that initially appear difficult to collect. New options to out-task and automate may make collection easier than you think.
  • Leveraging Outside Resources (Out-Tasking). Out-tasking is a variation of out-sourcing, but instead of contracting out a significant part of your AR program (which SageCircle rarely recommends) this technique refers to contracting out an activity or task. Out-tasking is especially appropriate for activities that are […]

Monitoring Analyst Opinion within the Context of Measurement

AR Metrics & MeasurementCounting analyst mentions is often an operational metric.  However, it is a very incomplete measurement because counting mentions typically does not consider the intensity, the exposure, the focus, the alignment, or the accuracy of the opinion; all critical factors in determining the net impact of an opinion on shaping market perception and influencing buying decisions. If you consider these other attributes it can become a form of performance metric  because it can demonstrate that AR reached out to the analyst and communicated information for them. 

In order to move beyond an at-best tactical performance metric such as counting mentions to something more strategic, AR needs to elevate its focus by tracking opinions and data points (relevance, perception, net impact, etc.) over time on a more regular basis.  Monitoring opinion can help AR understand the effectiveness of its work by tracking whether opinions are improving over time. For instance, merely counting that there were 20 quotes per quarter in Q1, Q2, Q3 and Q4 indicates little on AR effectiveness. However, tracking that overall opinion in those four quarters went from very negative in Q1 to negative in Q2 to neutral in Q3 and positive in Q4 shows that AR has been very effective in understanding the positions of the analysts and presenting the company’s case to them.

It is our recommendation that AR programs do not settle for simply counting mentions in the press and research notes, but move to include analyst opinion monitoring. However, in the spirit of making data collection practical, this does not mean that […]

Defining “Performance Metrics for Analyst Relations”

Background:  When building AR measurement programs, AR practitioners must distinguish between performance and operational metrics.    Performance metrics help AR teams measure progress against strategic goals while operational metrics measure utilization and productivity against plan.   

Performance metrics measure AR’s progress against strategic results.  They primarily are externally focused and typically fall into one of three categories: 1) Shape […]

You have to focus on influential analysts even if they are negative or unpleasant

An all too common comment from vendor executives is “That analyst is such a jerk, I don’t want anything to do with him.” Or maybe the executive thinks the analyst is out to get the vendor, an idiot, or just wants to extract money from the vendor. For whatever reason, the executive has decided not to brief or otherwise interact with the analyst because this influential analyst is unpleasant. 

On the other hand, this executive loves to talk with another analyst who is by no stretch of the imagination influential, but is nice, agrees with the executive’s points-of-view, and is just more pleasant.

A critical success factor for your AR program is getting your executives to understand analyst influence and to get on board with a plan to turn around negative or unpleasant analysts instead of just […]

Good post by IBM’s John Simonds on “Getting Your Executives to Cut Down Their Presentations To Analysts”

John is an AR professional running AR for IBM’s Lotus division. The post is well worth reading, click here to visit John’s Delusions of Adequacy blog. Here are a few extracts (with my emphasis in maroon):

2. If you can’t get your message delivered in 15 charts or less, you likely have clarification issues.

5. No chart is golden, (many) could (should) be sacrificed.

8. If the analyst wants to go off the charts, be willing to go as long as you stay on topic.

9. Use A/R to speak to the analyst before the briefing/discussion/meeting/conference to see […]

Tool for Sales – The Prospect Profile Form

icon-dollar-euro.jpgThe analysts possess a wealth of information that can help vendor sales organizations better understand their prospects. The question is how to get the information from the analysts. SageCircle has put together a simple process and checklist that AR can use to conduct a structured inquiry with key analysts to collect and organize important information about your prospects. The process is simple. Schedule an inquiry with one or two of your Tier 1 analysts (with whom you have Inquiry privileges). Use the questions on the Prospect Profile checklist to gather information from the analyst and enter the responses into the form. After finishing the inquiry, complete the form and forward it to sales.

There are two main categories of input that you are looking for: “Analyst’s Perceptions about the Prospect or its Peer Group” and “Analyst’s Perceptions about Your Differentiation in this Situation.” Within each main category there are sub questions like market, prospect and business challenges. 

Besides obtaining valuable information and insights for your sales teams, using this technique is also a great way to improve your relationships with key analysts. As we mentioned […]

Getting executives to agree to making changes to their presentation for an analyst briefing

SageCircle strategists review a number of presentations each month in the context of phone-based inquiries. First-time critiques often result in recommendations for significant revisions.  This is because atypical sales or marketing presentation does not produce the sequential flow or information content required for an effective analyst briefing.  Unfortunately, when a sales presentation is used with an analyst, it frequently results in a negative perception of the company and its products by the analyst.

For example, SageCircle conducted a presentation review with a new client. The AR team representative and the intended product spokesperson were on the phone. Upon review, the “deck” resembled a typical sales presentation and suggested changes met strong resistance. The spokesperson had very firm ideas on how his presentation had to be built. Many of his beliefs were rooted in years of successful selling, but were quite inappropriate for an analyst “deck.”

The impasse was resolved by stepping back from the immediacy of the presentation and focusing on the intended result – getting the analyst to agree with a set of perspectives held by the company.  From the spokesperson’s selling background, he agreed that to achieve this result, the message had to be tailored to the audience.  The spokesperson further admitted […]

Defining “analyst consulting day”

Analyst consulting days are full-day engagements where a vendor spends a significant sum to get the use of one or more analysts. Analyst consulting days are not to be confused with projects by the analyst firms’ consulting groups, which often have little or no analyst contribution. There is a distinction between contracting for “analyst consulting time” and contracting with the consulting side of an analyst firm. “Analyst consulting time” refers to purchasing the time of an individual analyst, usually in one-day units. Contracting with the consulting side of an analyst firm usually refers to research projects with specific deliverables that are designed to meet the intelligence, strategy or marketing needs of a vendor company. Multi-client studies are common deliverables from the consulting side.

Gartner uses the term SAS (strategic advisory service) to describe analyst consulting days. While other firms use […]