Making Data Collection for Measurement Practical [AR Practitioner Question]

AR Metrics & MeasurementQuestion:  How do you make data collection easier for AR measurement programs?

This question gets to the heart of the measurement challenge-if it is too difficult to do, it will not get done.  Making data collection practical involves selecting the right mix of metrics, leveraging outside resources, and automating many tasks.

[This post focuses on the data collection aspects of an effective measurement program.  Therefore, the following related topics will not be addressed 1) picking and prioritizing the right metrics, 2) distinguishing between operational and performance metrics, and 3) using metrics to track performance against pre-defined goals.  For discussion of these topics, please see Online SageContentTM Library series “Metrics and Program Measurement.”]

SageCircle Technique:

  • Selecting the Right Mix of Metrics. First, to make data collection practical, you must pick metrics that meet measurement program goals (e.g. track what you want to measure) and are easy and cost-effective to generate (e.g. data collection requires moderate/minimal effort). Be clear on what you want to measure and collect only that data so you can encourage AR team participation. However, do not reject metrics that initially appear difficult to collect. New options to out-task and automate may make collection easier than you think.
  • Leveraging Outside Resources (Out-Tasking). Out-tasking is a variation of out-sourcing, but instead of contracting out a significant part of your AR program (which SageCircle rarely recommends) this technique refers to contracting out an activity or task. Out-tasking is especially appropriate for activities that are […]

Monitoring Analyst Opinion within the Context of Measurement

AR Metrics & MeasurementCounting analyst mentions is often an operational metric.  However, it is a very incomplete measurement because counting mentions typically does not consider the intensity, the exposure, the focus, the alignment, or the accuracy of the opinion; all critical factors in determining the net impact of an opinion on shaping market perception and influencing buying decisions. If you consider these other attributes it can become a form of performance metric  because it can demonstrate that AR reached out to the analyst and communicated information for them. 

In order to move beyond an at-best tactical performance metric such as counting mentions to something more strategic, AR needs to elevate its focus by tracking opinions and data points (relevance, perception, net impact, etc.) over time on a more regular basis.  Monitoring opinion can help AR understand the effectiveness of its work by tracking whether opinions are improving over time. For instance, merely counting that there were 20 quotes per quarter in Q1, Q2, Q3 and Q4 indicates little on AR effectiveness. However, tracking that overall opinion in those four quarters went from very negative in Q1 to negative in Q2 to neutral in Q3 and positive in Q4 shows that AR has been very effective in understanding the positions of the analysts and presenting the company’s case to them.

It is our recommendation that AR programs do not settle for simply counting mentions in the press and research notes, but move to include analyst opinion monitoring. However, in the spirit of making data collection practical, this does not mean that […]

Defining “Performance Metrics for Analyst Relations”

Background:  When building AR measurement programs, AR practitioners must distinguish between performance and operational metrics.    Performance metrics help AR teams measure progress against strategic goals while operational metrics measure utilization and productivity against plan.   

Performance metrics measure AR’s progress against strategic results.  They primarily are externally focused and typically fall into one of three categories: 1) Shape […]

Defining “analyst consulting day”

Analyst consulting days are full-day engagements where a vendor spends a significant sum to get the use of one or more analysts. Analyst consulting days are not to be confused with projects by the analyst firms’ consulting groups, which often have little or no analyst contribution. There is a distinction between contracting for “analyst consulting time” and contracting with the consulting side of an analyst firm. “Analyst consulting time” refers to purchasing the time of an individual analyst, usually in one-day units. Contracting with the consulting side of an analyst firm usually refers to research projects with specific deliverables that are designed to meet the intelligence, strategy or marketing needs of a vendor company. Multi-client studies are common deliverables from the consulting side.

Gartner uses the term SAS (strategic advisory service) to describe analyst consulting days. While other firms use […]

How much to spend on analyst contracts [AR practitioner question]

question-mark-graphic.jpgInquiry: SageCircle received the following inquiry via e-mail: “Is our use/cost of the major analyst firms at about industry standard or better – especially as it relates to analyst contracts?”

“Are we spending the right amount on analyst contracts?” is a common question that SageCircle receives. This is one of a group of “standards” or “benchmarks” inquiries (see The Size of the AR Team [AR practitioner question]) that many AR managers wrestle with, often in response to their management’s demands for justification for budgets. While clients want us to provide a simple rule-of-thumb for analyst contracts (e.g., as a percentage of vendor revenue), we cannot provide it. Through our research, we have discovered that comparable vendors (in terms of markets, total revenues and number of employees) can have dramatically different analyst contract requirements.

The more important questions that need to be answered are: “Are the contracts providing us the services we need to reach our defined goals?  Are we managing the contracts to get full value? 

For end users clients, usually IT managers at large enterprises, the answers are much more clear cut. Even though enterprises use analysts for a variety of purposes (see Why technology buyers use the IT industry analysts), these purposes basically fall into either strategic and tactical decision support. Thus, spending can be focused on active topics and activities, especially where internal expertise is not available.

How much IT and telecommunications vendors spend on analyst contracts is dependent on a variety of factors. In this SageCircle blog post, we will focus on identifying the factors.

Breadth of usage – How many different functions in the company will analyst research and advice be supporting? The broader the usage, the more […]

Defining “Analyst Relations”

When you meet someone new in a social setting the topic often turns to “so where do you work? What do you do?”  Do you struggle with explaining Analyst Relations?

Many AR programs cannot give an “elevator pitch” on AR. You should have this available for not only those social settings, but also to explain your expertise to others in your company.  Here is a quick definition of AR that can be used when explaining what AR does:

“Analyst Relations takes advantage of the unique influence that the IT industry analysts have with our prospects and customers to help drive revenues. Analyst Relations works to influence analyst opinions regarding our company and our products to increase positive coverage in analyst research publications and analyst media quotes. Through briefings, inquiries, newsletters, AR portals, analyst firm events, and other tactics, we work to constantly maintain top-of-mind status with key analysts, so our company and products are frequently recommended by the analyst community.

As a corollary charter, Analyst Relations works with […]

Never assume during an annual renewal that the analyst service contract remains the same

Annual syndicated research subscriptions are a common approach for enterprises and vendors when it comes to gaining access to published research and advisory. However, for all the value and convenience in this type of contract, there is a potential “gotcha” to watch for during the contract renewal – changes in the terms and conditions.

Often contract renewals follow a simple path of adjusting the number of seats and add-on services based on past year’s usage, new requirements, and new offerings by the firm. Often the analyst firm sales representative will send along the new contract with a note that says “it is basically the same as last year, so please look at pages x and y to make sure we have captured the number of seats and services you need.  Then sign on page z.” If the client does not carefully go through the contract with a fine-tooth comb they might miss that the “basically the same” contract actually has some key changes to the terms and conditions that severely limit their use of the analyst services or gives the analyst firms the right to audit the client for contract compliance. 

In some cases, the firm sales rep does not know that the changes are there, they are simply using the new standard contract. In other cases, the sales rep is aware of the changes but does not […]

Operational framework: The 5 I’s of Analyst Relations

In the bustle of daily activities, it is sometimes hard for analyst relations (AR) managers to keep their teams focused on their key operational activities. SageCircle created the 5 I’s of Analyst Relations to provide an easy mantra of essential activities. The 5 I’s are:

  • Identify — The Most Influential Analysts
    • Ranked and tiered analyst list(s)
    • Continuous research on the analysts’ coverage
  • Interact — In the Correct Ways
    • Mix of one-to-one, one-to-many, none-to-many types
    • Mix of briefings, SAS, relationship meetings and client inquiries
  • Information — Most Appropriate in […]