Forced Transparency

March 23, 2017

Time magazine recently published an interesting piece titled “The real costs of ‘forced transparency’”[1]. The focus of that was on the impact of WikiLeaks’ “disclosures” of US intelligence agencies’ ability to access data in private and government hands, the impact on national governments, and their possible reactions and responses.

I would add to that good analysis two more potential impacts:

  1. These same revelations, on the ease of generating “forced transparency”, may feed the slowly growing trend of the US Government to resist providing online access (and offline access as well) to Freedom Of Information Act (FOIA) documents and data. The rationale offered, valid or not, would probably be along the lines that such access can only assist hacking efforts by opening ‘back doors’.
  2. These same revelations will, I suspect, also cause businesses providing many of the filings that those of us in competitive intelligence are interested in to (a) resist making certain filings citing a fear that their confidential data and documents can no longer be protected, and (b) press for changes to the FOIA (and other laws and regulations) to reduce such sensitive filings.

Of course, if the federal government moves in that direction, I expect that the states will follow – not necessarily quickly but inevitably.

[1] By Ian Bremmer, (accessed March 23, 2017).


March 17, 2017

One thing that those of us producing competitive intelligence strive for is accuracy. Well, to be more precise, our end users want accuracy – and can be very demanding of that. However, accuracy is a chimera.

Why? For several reasons, some independent, some inter-related:

  • When we are assessing hard, current facts, such as the size of a new plant, we have a fixed target to focus on. Or do we? Do we want the square footage of the plant, its capacity, or its current production? The first is precise, the others less so. Capacity is, at best, an estimate. Change the equipment, move some around, and you change capacity. As for current production, as soon as you estimate (that word again) it, it may change. You know what I mean – the target starts or reduces a second shift the week after you finish your research and analysis.
  • But not all current data is fixed. It is only fixed as of a moment in time. Take, for example, market share. What do we mean by that? What market? At what point in time or over what period? Do we also mean noting (past) trends (increases/decreases)? Does a market share that has steadily been increasing/decreasing mean that it will continue to increase/decrease? If so, why, how fast? Does it have a limit (other than 100%)?
  • When we are focusing on a competitor’s short-term and long-term plans, what we are really assessing, at least in part, is the target’s intention. What does the target plan to do? Why? What will make it change its plans? How quickly can and will the target change its plans – and based on what future events?
  • When we are assessing intention of a target, unless the target is an individual, we are assessing not only the intention of the CEO, but the intentions of the senior management team. Then, we must consider the ability – and willingness – of management and staff to carry out the direction of senior management. If you think that a firm moves in unison and accurately to the direction of its CEO, remember one word – bureaucracy.
  • When assessing the success or failure of a target’s past actions, we must be very clear in our mind what we mean by success or failure. Is that from the target’s perspective, from my perspective, both, or neither? And what does the past have to do with the present and the future? Are the same decision-makers still in the same positions? Is the target facing the same competitive forces now as then?
  • When assessing the likelihood of success or failure of a target’s current actions, we are dangerously close to the realm of conjecture. When assessing the likelihood of success or failure of a target’s intended actions, we have crossed over.

These are meant to show that the issues facing CI are squishier than your end users may understand. I am not saying that CI cannot contribute to a better understanding of what you and your firm face. It can and does. But it does that by reducing uncertainty. Any effort to force CI to deliver certainty will doom it to failure.

Ex Libris

March 9, 2017

The other day, I was talking with Lora Bray, a friend who is a member of the Special Libraries Association (SLA), about CI and special librarians. The reason for the conversation is a new book Carolyn Vella and I have coming out. But more on that at a later date.

The issue we talked about is that while some special librarians are interested in competitive intelligence, there is not yet a lot of movement of them from that career to into one in CI. And that is too bad for them – and bad for business as well. Why? Let me explain.

In developing CI, several skills, including research experience and discipline, analytical skills, and industry experience, are very useful. Trained librarians possess a good measure of them:

They are trained in secondary research, probably far better than those of us whose “training” consisted in researching a couple of college papers years ago. And secondary research is not only a key element in providing CI, it is an important predicate to doing effective primary, particularly elicitation, interviews.

They have developed analytical skills. Effective secondary research requires analytical skills in defining the research scope, including “push backs”. It then requires analysis to separate useful and critical data from a mass of trivia and repetitive data.

What they usually lack are two other key elements: primary research training and industry specific experience.

By training in primary research, I mean in managing and conducting interviews, particularly elicitation interviews. But that training can be acquired relatively quickly.

By Industry specific experience, I mean line experience and/or formal education on the technology underlying an industry or product. But, that requirement is overly preferred in hiring. You don’t believe me? Look, for example, at the giant consulting firms that senior management often hires – how many of the associates, managers, and partners ever designed, made, serviced, or sold your specific product (or service)? Hint: not very many. Especially with respect to CI, industry specific experience is way over-valued. In my experience, an internal CI staffer should, ideally, have both CI experience and industry experience. But, the balance, when that is not available, and it usually is not, should lean heavily towards more CI experience rather than more industry specific experience. Why? You can usually learn about the basics of an industry or product faster than you can master doing effective, ethical CI. And, almost every industry is today facing technological and cultural changes, and even upheavals, which will put a greater value on being able to learn than having learned.

So, if you are adding to your CI team – formal or informal – look at the librarians. And librarians – look at CI.






The Shape of Things to Come (Part 2)

February 27, 2017

Last week, I posted my take on the future of FOIA (Freedom of Information Act) requests on the US government. What I neglected to do was to discuss the possible impact of relatively recent changes made in the US law by the FOIA Improvement Act of 2016 offered as improving transparency and access. From here, it gets a little technical.

Two of the relevant 2016 changes, as summarized by the US Department of Justice, are as follows:

  1. “Agencies ‘shall withhold information’ under the FOIA ‘only if the agency reasonably foresees that disclosure would harm an interest protected by an exemption’ or ‘disclosure is prohibited by law.’
  2. “Agencies shall ‘consider whether partial disclosure of information is possible whenever the agency determines that a full disclosure of a requested record is not possible.’”[1]

Now, to be fair, these changes would appear to undercut my negative view of the future use of the US FOIA in CI. However, they do not.

As for #1, this does not change the current underlying interpretation of the FOIA that its Exemption 4 of the FOIA still covers

“two distinct categories of information in federal agency records, (1) trade secrets, and (2) information that is (a) commercial or financial, and (b) obtained from a person, and (c) privileged or confidential.”[2]

In other words, anything falling into either category of Exemption 4 cannot be released.

The current interpretations of the scope of Exemption 4 are very broad. With a few exceptions, the federal courts have held that “trade secrets” here have a meaning broader than the usual meaning. That is, it covers “virtually any information that provides a competitive advantage” [3]. That means more is kept from release than is covered by what most of us understand a trade secret to be.

As #2’s “privileged or confidential”, the current standard is not merely whether the “information would customarily [not] be disclosed to the public by the person from whom it was obtained” [4], but rather

“commercial or financial matter is ‘confidential’ for purposes of the exemption if disclosure of the information is likely to have either of the following effects: (1) to impair the Government’s ability to obtain necessary information in the future; or (2) to cause substantial harm to the competitive position of the person from whom the information was obtained” [5].

In other words, what the FOIA protects from disclosure in the context of CI is, in practice, even broader than the plain language of Exemption 4. So, adding language which directs an agency to “foresee” this or “consider” that will not change the overly protective standards now in place.

[1], numbers added.





Tag – You’re It!

February 16, 2017

I was reading the most recent issue of Successful Meetings. Why, you ask? Because if I am going to work – or protect – a meeting, conference or trade show with respect to CI, I should how they are being run and how they are changing.

Anyway, it had an interesting article for people who are being told that they are now doing meeting planning in addition to everything else they do[1]. Taking it as inspiration, here are a couple of tips for DIYers who are (suddenly) told “Well, you know all about competitive intelligence, so why don’t you provide us with some in addition to everything else you are doing”:

  1. Be prepared to get going; While this may not have happened to you yet, the operative word here is “yet”. While it is not always true for CI teams that “If you build it, they will come”, when you are doing your own CI, eventually others will (a) figure out that you are doing this, and (b) some will realize that the CI is adding value. Then, it is but one step to being drafted, so prepare for it. Look at the next 8 tips and see where you stand now with respect to each one.
  2. Take advantage of training and education:: Take a hard look at any groups of which you are a member. Then check on groups that your organization or other employees are members of. Have their newsletters and magazines dealt with CI? If so, start checking the latest issues. Have they offered sessions on CI or related areas (strategic intelligence, war gaming, scenario development, long-range scanning)? If so, see if you can take a webinar of a past session. Also, check the agendas of their forth-coming meetings for sessions on CI that you can attend. There are also a variety of groups that run formal training programs and even annual sessions on CI. Among them are the Institute for Competitive Intelligence[2] and the Fuld-Gilad-Herring Academy of Competitive Intelligence. Check them and others out.
  3. Stay current: There are numerous websites and blogs – such as this one – that you should tap into for current developments and discussions about CI. Staying current on CI is now a part of your job – it should have been at least a small part already.
  4. Identify internal and external partners: Here is where your networking is key. If you already have an internal network, use it. If not, start developing one now. Look around for potential external partners for your future research: think trade associations, affiliates and subsidiaries, academic research centers, suppliers, customers, and government agencies.
  5. Find out the reasons for the assignments: To do your best CI research and analysis, you must know not only what they (whoever they are) want, but, more importantly, what they intend to do with it. Knowing that, you may often be able to suggest an alternative line of research or research target that is faster or cheaper or more reliable.
  6. Show ROI: It helps to try to show the return on your investments (ROI) in CI. For example, if your analysis shows that a planned new venture is very, very risky, casually note that the15 hours of work you did will save the organization $6.2 million it would have spent on going forward with a failing venture.
  7. Be smart about non-ROI statistics: ROI is not all that your CI can provide and not the only thing to point to. How about time? If your CI doubles the time that your organization now has to respond to a competitor’s forthcoming new pricing regime, when compared with the last time this happened, tell people.[3]
  8. Improve your existing skills and add new ones: You already are doing some CI so you have some basic knowledge – I hope. So first, work on improving your existing third-party skills, such as working with others, managing meetings, and communication, both written and oral. Good CI that is not properly communicated is not useful or likely to be used. Then work on adding new skills such as interviewing third parties, team management, improved technical expertise on what your firm does, and working meetings and conventions.
  9. Promote your value and CI’s value: Do not be shy about what you are doing and what value the (new) CI is bringing to your team/organization. Diplomatically use phrases such as “Our blind spots were…”, “Filling in the following gaps…”, “Providing us with an opportunity we were not fully aware of…”, and “Avoiding a previously unexpected threat…”.

[1] Andrea Doyle, “Planning for Double Duty”, Successful Meetings, February 2017, pp. 12-15.

[2] In the interest of full disclosure, I am on the faculty of ICI.

[3] For more on this, see John J. McGonagle and Carolyn M. Vella, Bottom Line Competitive Intelligence, Praeger 2002.

Circular Economy?

There is a lot of talk in business and educational circles about the concept of the “circular economy”. As befits such a description, there are a variety of overlapping definitions. Here is one:

“A circular economy is one that is restorative and regenerative by design, and which aims to keep products, components and materials at their highest utility and value at all times, distinguishing between technical and biological cycles.”[1]

Why am I mentioning this in a blog on CI? Because there is a key lesson to be found in the debate about a process which tries to more fully integrate corporate operations and to enable management to see what is going on, both in the supply chain and in the distribution chain, while incorporating the management of critical environmental issues. And all of this is to be seamless.

What is the lesson? The lesson is that none of the debates on this concept (or related concepts) has, at least according to my personal research, ever mentioned competitive (or business or competitor or strategic) intelligence. Think about it. CI is missing from this debate. Why?

Probably because CI is still just bolted onto businesses. In general, it is not incorporated into overall business processes. Look at the classic CI process for evidence of this: someone must affirmatively decide that he/she/they need intelligence and then formally assign the task elsewhere. The recipient then produces an answer or answers on a specific schedule. Of course, if any question is not spot on, then the research and analysis is probably not either. If the research and intelligence is too late, or is rejected or ignored by the internal client for her/his own reasons then the CI is useless – or more accurately not used.

This is not the case with the DIYers of CI or with those few CI programs where the CI person or team has the ability – and incentives – to define the intelligence needs and to generate the necessary research and analysis on their own initiative. In those cases, the end-user/customer and analyst are, at least initially, the same. And, in the case of the DIYer, there is no “fatal disconnect” between the decision-maker and the analyst.

To me, that seems to mean that at least one future of CI lies in that direction, joining in the circular economy process. How do we do that? Your thoughts?

[1] Ellen MacArthur Foundation,, accessed 2/8/17.

Planning CI Research and Analysis

February 2, 2017

There are a lot of tricks to planning and executing effective CI research and analysis. Here are three proven ones:

  • Drill down on what you are trying to find out. Whether it is for you or for someone else, before you start your research, ask what decision you (or someone else) can make or action you (or they) can take once you are done. If you cannot answer that, step back and rework the assignment. That way you avoid wasting time in the “nice to know” swamp rather than staying on the “need to know” highway.
  • Scope out where you will probably be looking before you start looking. Divide the potential sources – and leads to other sources – into primary and secondary. Start with and plan to finish the first round of secondary before starting the primary. Save the primary for when you have “mastered” the issue, so your interviews will be short and to the point. You can avoid wasting a valuable, hard to schedule, interview getting what you could have collected from reading.
  • Again, before you start, write down your key question, the core of your assignment. Then, list the 3 or 4 questions you must answer to get to the core question. If necessary, break down the sub-questions one more time. You now have your research outline. Think it through. How likely is it that you can conduct the research and produce the necessary analysis – under your time and cost constraints? Put a number on it. You and I know it is only a rough estimate, but you are already calling on your subconscious (or your gut, your call) to help on your project. Look at the numbers you assigned: why is it the third question has only a 25% likelihood of success, while the fifth question is at a 90% likelihood? How you can restate the third question to make it more likely to succeed in answering it?

In other words, don’t start until you have it clear in your mind where you are likely to go – even if you do not always know where that is.