Archive

Archive for June, 2009

The Personal Data Eco-System

June 25th, 2009

Cross-post from my CRM..meet VRM blog.

This post is a short(ish) summary of a working session led by Drummond Reed and me at the recent West Coast VRM Workshop, and also an introduction to the Kantara workgroup in which we are going to move this debate forward. It is also part of the thinking that will short emerge in a Mydex white paper.

At the VRM workshop, we discussed the need for the concept of the Personal Data Store, what it would do in practice, and what that will ultimately enable.

Why we need such things – because individuals have a complex need to manage personal information over a lifetime, and the tools they have at their disposal today to do so are inadequate. Existing tools include the brain (which is good but does not have enough RAM, onboard storage, or an ethernet socket……thankfully), stand alone data stores (paper, spreadsheets, phones, which are good but not connected in secure ways that enable user-driven data aggregation and sharing), and supplier based data stores (which can be tactically good but are run under the supplier provided terms and conditions). NB Our current perception of ‘personal data stores’ is shaped by the good ones that are out their (e.g. my online bank, my online health vault); what we need is all of that functionality, and more – but working FOR ME.

What they will do/ enable – the term Personal Data Store is not an ideal term to describe a complex set of functions, but it is what it is until we get a better one (the analogy I’d use in more ways than one is the term ‘data warehouse’ – again a simplistic term that masks a lot of complex activity). A Personal Data Store can take two basic forms:

Operational Data Stores – that get things done, and only need store sufficient breadth and depth of data to fulfill the operation they are built for (e.g. pay a credit card bill, book a doctor’s appointment, order my groceries).

Analytical Data Stores – that underpin and enable decision making, and which typically need a more tightly defined, but much deeper data-set that includes data from a range of aspects of life rather than just that from one specific operation (e.g. plan a home move, buy a car, organise an overseas trip).

A sub-set of the individual’s overall data requirement will lie in both of the above, this being the data that then integrates decision-making and doing.

In both cases, the functionality required is to source, gather, manage, enhance and selectively disclose data (to presentation layers, interfaces or applications).

We also discussed ‘who has what data on you’ and introduced the following diagrams to explain current state and target state (post deployment of Volunteered Personal Information (VPI) tech and standards).

The key terms that require explanation are:

My Data – is the data that is undeniably within, and only within, the  domain of an individual. It’s defining characteristic is that it has demonstrably not been made available to any other party under a signed, binding agreement. This space has been increasingly encroached upon by technology and organisations in recent history (e.g. behavioural tracking tools like Phorm) and this encroachment will continue. Indeed a general comment can be made that ‘my data’ equates to privacy in the context of personal data; so the rise of the surveillance society and state is a direct assault on ‘My Data’. Management of ‘My Data’ can be run by the individual themselves, or outsourced to a ‘fourth party service’.

Your Data – is the data that is undeniably within the domain of an organisation; either private, public or third sector. Proxy views of this data may exist elsewhere but are only that. This data would include, for example, the organisations own master records of their product/ service range, their pricing, their costs, their sales outlets and channels. Customer-facing views of much of Your Data is made available for reproduction in the ‘Our Data’ intersect.

Our Data – is the data that is jointly accessible to both buyer and seller/ service provider, and also potentially to any other parties to an interaction, transaction or relationship. It is the data that is generated through engaging in interactions and transactions in and around a customer/ supplier relationship. Despite being ‘our’ data, it is probably technically owned, or at least provided under terms of service designed by the seller/ service provider; in practical terms this also means that the seller/ service provider dictates the formats in which this data exists/ is made available.

Their Data – is the data built/ owned/ sold by third party data aggregators, e.g. credit bureaux, marketing data providers in all their forms. It’s defining characteristic is that it is only available/ accessible by buying/ licensing it from the owner.

Everybody’s Data – is the public domain data, typically developed/ run by large, public sector(ish) entities including local government (electoral roll), Post Offices (postal address files), mapping bureau (GIS). Typically this data is accessible under contract, but the barriers to accessing these contracts are set low – although often not low enough that an individual can engage with them easily.

The Basic Identifier Set/ Bit in the Middle – this is the core personal identity data which, like it or not, exists largely in the public domain – most typically (but not exclusively) as a result of electoral rolls being made available publicly, and specifically to service providers who wish to build things from them. This characteristic is that which enables the whole personal eco-system and its impact on data privacy to exist, with the individual as the un-knowing ‘point of integration’ for data about them.

Propeller Current State

The ovals in the venn diagram represent the static state, i.e. where does data live at a point in time. The flow arrows show where data flows to and from in this eco-system; I use red to signify data flowing under terms and conditions NOT controlled by the individual data subject.

Flow 1 (My Data to Your Data, and My Data to Our Data) – Individuals provide data to organisations under terms and conditions set by the organisation, the individual being offered a ‘take it or leave it’ set of options. Some granularity is often offered around choices for onward data sharing and use, i.e. the ‘tick boxes’ we all know and which are one of the main bitsof legacy CRM that VRM will fix.

Flow 2 (Your Data to Your Data, including Our Data) – Organisations share data with other organisations, usually through a back-channel, i.e. the details of the sharing relationship are typically not known to the data subject.

Flow 3 (Your Data, including Our Data to Their Data) – Organisations share data with a specific type of other organisation, data aggregators, under terms and conditions that enable onward sale. Typically the sharer is paid for this data/ has a stake in the re-sale value.

Flow 4 (Everybody’s Data to Their Data) – Data Aggregators use public domain data sources to initiate and extend their commercial data assets.

The target state is shown below, a different scenario altogether – and one which I believe will unfold incrementally over the next ten years or so…..data attribute by data attribute, customer/ supplier management process by customer/ supplier management process, industry sector by industry sector. In this scenario, the individual and ‘My Data’ becomes the dominant source of many valuable data types (e.g. buying intentions, verified changes of circumstance), and in doing so eliminates vast amounts of guesswork and waste from existing customer/ citizen managment processes.

The key new capabilities required to enable this to happen are those being worked on in the User Driven and Volunteered Personal Information work groups at Kantara (one tech group, one policy/ commerce one), and elsewhere within and around Project VRM. The new capabilities will consist of:

- personal data store(s), both operational and analytical

- data and technical standards around the sharing of volunteered personal information

- volunteered personal information sharing agreements (i.e. contracts driven by the individual perspective, creative commons-like icons for VPI sharing scenarios)

- audit and compliance mechanics

Around those capabilities, we will need to build a compelling story that clearly articulates, in a shared lexicon (thanks to Craig Burton for reminding us of the importance of this – watch this space), the benefits of the approach – for both individuals and organisations.

The target state that will emerge once these capabilities begin to impact will include the 4 additional individual-driven information flows over and above the current ones. The defining characteristic of these new flows is that the can only be initiated by the data subject themselves, and most will only occur when the receiving entity has ‘signed’ the terms and conditions asserted by the individual/ data subject. The new flows are:

Flow 5 (My Data to Your Data (inc Our Data) – Individuals will share more high value, volunteered information with their existing and potential suppliers, eliminating guesswork and waste from many customer management processes. In turn, organisations will share their own expertise/ data with individuals, adding value to the relationship.

Flow 6 (Everybody’s Data to My Data) – With their new, more sophisticated personal information management tools, individuals will be able to take direct feeds from public domain sources for use on their own mashups and applications (e.g. crime maps covering where I live/ travel)

Flow 7 (My Data to (someone else’s) My Data) – An enhanced version of ‘peer to peer’ information sharing.

Flow 8 (My Data to Their Data) – The (currently) unlikely concept of the individual making their volunteered information available to/ through the data aggregators. Indeed we are already starting to see the plumbing for this new flow being put in place with the launch of the Acxiom Identity Card.

Propeller Target State

The implications of the above are enormous, my projection being that over time some 80% of customer management processes will be driven from ‘My Data’. I’m pretty confident about that, a) because we are already see-ing the beginning of the change in the current rush for ‘user generated content’ (VPI without the contract), and b) because the economics will stack up. Organisation need data to run their operations – they don’t really mind where it comes from. So, if a new source emerges that is richer, deeper, more accurate, less toxic – and all at lower cost than existing sources; then organisations will use this source.

It won’t happen overnight obviously; as mentioned above specific tools, processes and commercial approaches need to emerge before this information begins to flow – and even then the shift will be slow but steady, probably beginning with Buying Intention data as it is the most obvious entry point with enough impact to trigger the change. That said, the Mydex social enterprise already has a working proof of concept up and running showing much of the above working. A technical write up of the proof of concept build can be found here. And the market implications of this are explored in more detail in new research on the market value of VPI shortly to be published by Alan Mitchell at Ctrl-Shift.

The two hour session at the VRM workshop was barely enough to scratch the surface of the above issues, so the plan is to continue the dialogue and begin specifying the capabilities required in detail in the User Driven and Volunteered Personal Information (technology) workgroup at The Kantara Initiative. The workgroup charter can be found here. A parallel workgroup focused on business and policy aspects will also be launched in the next few weeks. Anyone wishing to get involved in the workgroup can sign up to the mailing list here and we’ll get started with the work in the next couple of weeks.

Post to Twitter Tweet This Post

  • Share/Bookmark

Data, Privacy, Project VRM, vpi

Personal Information Management Services

June 9th, 2009

The British Standards Institute have produced a new set of standards for what they call PIMS (Personal Information Management Systems).

Of course, this PIMS is the complete opposite of the PIMS we have been talking about for the last couple of years. Their standard is for organisations managing individuals’ personal data. Our PIMS are for individuals using information to manage their affairs.

‘My PIMS’ versus ‘Their PIMS’. Oh dear, more terminological confusion here we come!

Post to Twitter Tweet This Post

  • Share/Bookmark

Buyer centric services, Resources and Papers

Do consumers really know what they want?

June 7th, 2009

The more I talk to people about consumer decision-making and the potential for buyer-centric services, the more I hear what appears to be a new conventional wisdom: that consumers don’t know what they want until marketers tell them.

This was one of the pushbacks I got from my talk at Nottingham Business School. Like so much else that’s said about the so-called ‘irrationality’ of consumer decision-making, it’s a) more complicated than the simplistic slogan and b) fuelled to a large degree by marketers’ own self-serving propaganda.

So let’s look a little closer.

First, there is the whole debate about the role of conscious and unconscious processes in decision-making. I’ve touched on that elsewhere so won’t return to it here. So what else is there?

Innovation

Well, there is one important area where it is absolutely true that consumers don’t what they want until marketers tell them: the arena of innovation where the consumer doesn’t know what’s possible.

For example, he is ignorant of technological or other capabilities and doesn’t know that it’s possible to fly through the air in a steel tube, or talk to a person on the other side of the world in real time, so he thinks he has to go by boat or write a letter.

This is probably the most important area where the line ‘consumers don’t know what they want until marketers tell them’ is absolutely true. It’s the background to Henry Ford’s oft-quoted remark that if he had asked consumers what they wanted, they wouldn’t have said a motor car; they would have said a faster horse. It’s where innovators and inventors come along and say ‘you never knew this before, but now it’s possible to do X!’

But we also have to keep it in perspective. Time and time again, studies of new product launches show that the vast majority of so-called ‘new’ products are actually new versions of old products – an added tweak or feature, a variant of some sort. A tiny minority of supposedly new products – around 1-2% – are actually new to the world. So while it’s true that consumers don’t know that they want innovations till they see them, this truth actually only accounts for a tiny proportion of total marketing activity.

Clever marketing?

So, apart from this tiny proportion, where else does the adage hold true? Well, there are number of areas where it seems like it holds true, but probably doesn’t. Here are three examples:

  • The consumer doesn’t know what’s available. In most markets, especially where consumers are relative novices, they only have a cursory knowledge of what’s available on the market. Because the costs of searching for information about these different choices is so high they often don’t bother. In these circumstances, they become at least partially reliant on marketers telling them what’s available – and when they come across what they want, they go out and buy.

Viewed from the point of view of the marketer, this looks like the consumers waiting for the marketer to tell them what they want, but actually it’s nothing of the sort. Consumers’ apparent passivity is a by-product of the high costs of searching, sifting, comparing what’s available. The job of buyer-centric services is to help consumers know what’s available, thereby reducing their dependency on this sort of spoon-feeding.

  • The consumer doesn’t know what’s best In some cases, even where the consumer is aware of a wide range of alternatives, he still doesn’t know which option to go for: he needs advice. Again, this is especially true when the consumer is a relative novice and where the product or service is relatively unfamiliar or complex.

What the consumer really needs here is trustworthy advice. But usually that’s not available at an affordable price, so the consumer has to take a different approach. Historically, one of the lowest risk routes available was to opt for the most reputable, most famous supplier i.e. the one that did the most advertising.

Again, the ‘evidence’ seems to show that it is the marketer telling consumers want they want, but actually this evidence is just a manifestation of a deeper issue – the high costs of getting trustworthy advice.

The job of buyer-centric services is to provide the trustworthy advice (see Problem Solving Communities) thereby reducing dependentce on these short-cuts.

  • Impulse purchasing, where the consumer is titillated by the marketer’s marketing I remember once, I went out and the weather turned nasty. I was on my way home feeling cold, wet, hungry and miserable when I saw an ad for Heinz Tomato Soup. I looked at the ad and thought ‘that’s just what I want to warm and comfort me’ – and bought a tin there and then. I didn’t know that I wanted a bowl of hot tomato soup until the ad ‘told’ me and triggered the desire.

Marketing activities such as these crystallise desires by stimulating consumers’ senses. This is the secret behind impulse purchases, and it will remain a feature of life as long as human beings have impulses.

But again, if you look at purchasing as a whole – especially in terms of amounts of money spent – most purchases aren’t impulse, they are considered to some degree or other. And on many occasions, the consumer defaults to an impulse approach because the cost or complexity of making a better, more informed decision is so high.

So if we look at the above four scenarios, we discover that only one of them really holds true: the case of ‘newness’ where much of the value that’s being provided comes from the very fact that nobody has thought of this before. The other three areas where it seems that consumers need to be told what they want are actually symptoms of the deeper problem: that in today’s commercial environment, the costs of decision-making are so high that most people opt for short-cuts, because otherwise they would go mad.

When we do know what we want

The other side of the coin is that there are also a number of cases where it’s palpably not true that consumers need to be told what they want. In every market you can think of, there is always a spectrum of consumers ranging from the complete novice who doesn’t even know what questions to ask, to the absolute connoisseur. In other words, market by market, category by category, product by product, situation by situation we are all of us on some sort of learning curve.

The more experienced and knowledgeable we become, the more we know what we want and the less helpful marketers trying to tell us otherwise becomes. In fact, at this end of the spectrum the boot moves to the other foot, where marketers need to engage with these consumers because they know what they want better than the marketers! This is the impetus behind the growing interest in ‘co-creation’.

A common half way house here is where people ‘sort of’ know what they want, but find it hard to articulate and express.

The really big area is in the middle: the many cases where consumers currently rely on marketers telling them what they want because, the way markets currently work, the sheer hassle of doing anything different is simply much too much.

The buyer-centric opportunity

Now, if we look through this list, we discover the potential for a whole range of different buyer-centric services. For example:

  • Where the consumer doesn’t know what’s available, making it easier and quicker for the consumer to find out (by for example, using search, peer-to-peer, buyer’s guide and other mechanisms)
  • Where the consumer defaults to heuristics for lack of good advice – here the buyer-centric service can make the consumer less reliant on the marketer by providing better advice via peer reviews, expert reviews, problem solving communities and the like.
  • Where the consumer needs help in articulating exactly what they want/need. Looking forward, this is probably one of the richest areas of buyer-centric service, and it’s made possible by consumer-to-consumer information sharing: ‘I might not have been on this journey before, but many others have – and I can pick their brains to help me work out what’s right, and what’s not right, for me’.
  • Where the consumer wants to specify what they want but can’t get. This is the arena of specialist ‘request for proposal’ services which reverse the flow and which help consumers to talk to marketers and say ‘actually, this what I want’.

So what’s our net conclusion?

  • First, there is a role for the marketer ‘telling consumers what they want’. But in reality, it’s actually quite restricted – mostly to the arena of innovation.
  • Second and much more important, there is a massive unmet need for services that help consumers work out and articulate what they want for themselves.

Most marketers’ claims about consumers needing to be told what they want do not relate to the passivity or lack of imagination of consumers – they relate to the costs consumers incur when they go to market; costs which are, for the most part, created by marketers themselves; costs which make navigation, choice etc expensive and difficult and which prompt consumers to opt, instead, for whatever marketers put in front of them.

Alan Mitchell

Post to Twitter Tweet This Post

  • Share/Bookmark

Advertising, Branding, Buyer centric services, Marketing, The Persuasion Paradigm, Uncategorized

Twitter links powered by Tweet This v1.6.1, a WordPress plugin for Twitter.