Big data, social data: which matters more?

By all accounts, there’s a big data revolution on its way, and soon. New, distributed, and increasingly real time database and data warehousing solutions have made big data storage and querying more viable. Data collection, of course, continues apace. And the number of data sources available, too, continues to grow.

The big data problem and solution, as it stands today, is very simply a matter of: what to do with it. Data reveals insights only as good as the organization mining for them. Even patterns need to be coded into queries — and that has to be done by somebody interested in searching for the pattern in the first place.

So while big data holds an immense amount of potential insight — it’s not obvious what this insight is. Nor whether, once identified, it can be made useful. (To wit, the many data analysts currently confounded by financial breakdowns.)

Given that big data is the type of data to make its truths at scale, that is, by means of high altitude “observations” of very small things, two orders of the big data query emerge: the big and the small. The big, in which the “meaning” of the data is determined. And the small, or the relevant data itself.

There’s no finding value in the small bits of data without first determining the big picture views one hopes to obtain. The need for both big data strategy as well as big data tactics is fascinating. It should not only open new vistas on worlds and patterns not seen before; it should lead to new kinds of business, decision-making, forecasting, marketing, and much more.

Where then does social data fit in? Social data is data about users: their activities, identities, habits, relationships, interests etc on social networks and social media. Social data should be about what users do. Its the exhaust, if you will, of their actions and communication. And ideally well suited to the aims of commerce.

Sometimes it seems that big data contains social data. Other times not. But if big data includes social data within its purview, then an interesting question arises. For social data, presumably, is a different kind of data.

The issue concerns what the data means. And since social data is often activity data, it’s more than data. A tweet may be tweeted to somebody. A share, because it expresses a user’s interests. Events attended because there are friends there. Or because the user is a fan.

In other words, social data isn’t data about something, it’s data created by the action of somebody. Data about events, things, objects is that: objective. Data produced by people interacting and communicating is subjective: it needs to be interpreted, because it is intentional.

It would seem that these two kinds of data won’t mix very well. Data about a population, for example, vs data created by its members. The former view of big data would suggest making use of patterns for efficiencies. The social data view would suggest micro-targeting individuals based on their behaviors. The former wants to better grasp correlations, high level views, and find meaning by mining. The latter wants to describe individuals more accurately, richly, and target behaviors based on expectations.

Big data and social data are not one and the same. But nor are they mutually exclusive. Both tell stories worth paying attention to. It will be interesting to see what comes for each — and of course, who is involved.

Posted in All | Tagged , | View Comments

Lean UX and lean startups: is trial and error the best way forward?

Lean UX is meant to be the user experience design approach best suited to the lean startup. Lean startups are meant to be the best business approach suited to the startup industry. And agile development, it goes without saying, the best development model.

It’s hard to contest these on the basis of budgets, market conditions, and even to some extent the needs of social tools early in development. Developers need users, not just to test out product stability and functionality, but to provide feedback also. By starting small, startups get to test out their designs for MVP.

But I can’t help wonder whether this method is the best we can come up with. For in some respects it is less a method and more a justification of trial and error by means of factors unrelated to design. Developers, and designers, surely have expectations of what will happen when their social tool is first used. Entrepreneurs surely have expectations of the same. Perhaps developers and designers base their insights on personal or industry observations. While entrepreneurs might be more informed by the business impact or problem-solution assumptions that they have made.

While there is nothing egregiously misguided about either of these approaches. They’re eminently practical. But given that so many social startups either fail outright, or soon pivot (and sometimes more than once), you can’t help but wonder if there’s a something missing.

From personal professional experience, as well as excessive use of social tools, it strikes me that the lean startup approach lacks a certain amount of spherical mass when it comes to social design. Not that users and social are an afterthought. But that they are an assumption. It is assumed, on the basis of success elsewhere (logical, yes), that users can be expected to adopt and embrace this in the same manner they use that (fallacious).

If we have learned anything, it is that social is not just technology and technique, but also culture, adoption, beach-heading, community management, and so much more. The assumption that what works in one context will work equally well in a different one is perhaps logical. But the conclusion drawn from it — plow ahead and do more or less what they did, but marginally better — is false. Users don’t make a move for the marginally better.

The lack of courage comes into play then when it comes to thinking both differently and better. One might blame this on the industry’s disposition towards financial risk-taking; which is accompanied by an aversion to risk in the user experience department.

That entrepreneurs might be more keen to spend large sums of money on things that more or less exist elsewhere in the marketplace, but shy from the risk of new or different user experiences, makes no sense. And certainly isn’t a design methodology. It suggests to me only that the industry has more confidence in the proven use of existing social tools than it does in its understanding of users, what they want, do, and why.

Every successful new social tool took a risk on user behaviors and social outcomes. Users are entirely capable of new experiences. They can be understood, and their responses to new social products can be anticipated. So, too, can social outcomes — or what happens when user adoption scales.

Perhaps it’s just me, and my own bias. Perhaps it is that neither design nor engineering pass through much social theory, anthropology, or psychology. Perhaps it is just how the industry works — risk on financially, risk off on design. From where I stand, however, the less lean startup methodology could use some fleshing out.

Posted in All | Tagged , , , | View Comments

The secret sauce of social

This is for anyone who enjoys thinking about what makes social media what it is, how it works, and why. In particular, it’s for user experience and interaction designers. But there are some morsels in here that should be helpful for those of you professionally committed to the social media industry, in whatever form or manner.

In old school philosophical style, I will begin with my proximate enemy. My proximate enemy is the concept of “feedback loops.” Patina’d with a touch of the de riguer, “feedback loops” are often referenced as an accounting of social media’s virality. These loops describe the mechanism of social media participation. Feedback loops exist, in other domains, it is true. And feedback loops are a common feature of systems. But social media, and social tools in particular, are social systems, not mechanical, biological, climactic, or other operational systems. Social systems are reproduced not by system processes, but by meaningful exchanges among participants: in short, people.

Feedback is an amplifying recycling of a source, say, a Fender Stratocaster in the hands of one Mr. Hendrix. It owes to the distance between two elements: a pickup, and a speaker. Close the distance between the two, and the signal tone amplifies itself, resulting in distorted feedback. Love it, but not an explanation of social media use, because it is acoustic.

Feedback loops fail as an explanation of social media engagement because they are a reproduction or amplification of the same: a single source. Social systems are reproduced on the basis of communication. And communication is dialogical. That is, it involves two or more participants in meaningful exchange. The common “feedback” features of social — likes, retweets, follows, comments, and so on — depend on the actions of individual users. The secret sauce, then, is in facilitating and amplifying not a single signal, but the coupling of signal. For one signal, a response. The response of an other (user).

Social engagement is built on social action. Social action is action of users aware that there are others. Not all social action solicits direct responses and replies, but all social action has in it the appeal to a response. In face to face situations, a look of acknowledgement suffices much of the time. But in mediated social contexts, there is no unilateral means of securing acknowledgment. Social media are built on separation, absence, and deferral. So the intrinsic appeal of social action — a feature, if you will, so fundamental to human social interaction that it must be accepted as a given — always remains. It is residue, ambiguous and unresolved, and it is the first key ingredient of our special sauce.

Social action is dead unless taken up by somebody. All of culture, all of language, and all of speech is “designed,” if you will, to make the improbable more probable. That is, to make communication more probable. Familiarity of meanings, use of a structured form of expression, norms and etiquette and innumerable practices all conspire to make it more likely that we are able to communicate with each other. So then, the challenge for any social tool is to make communication more probable.

Given that in mediated social systems, users sit at small backlit boxes reaching through the wire to share their thoughts and activities, the “design” of the application through which they engage necessarily structures and organizes their experience. But all of our socio technical systems harken back to original forms. Social tools are still part telephone. Part telegraph. Part radio. Part television.

You wait for a reply. The phone rings. It calls you — you are being called to answer. You place a phone call. The phone rings — a voice calls out: “It’s for you.” This is the system coupling of social action: action – response. And it is what becomes more challenging in social tool design, for unlike the phone, social tools are designed for asynchronous use.

Asynchronicity is distance. Distance not in space, but in time. Nearness, closeness, and immediacy are the human experience equivalents of space. This distance is inserted into social action and comes to separate action from response. The appeal — our first ingredient — is now at work. For it takes the form of waiting: urgent, distracted, compulsive, patient, or forgetful waiting.

Communication is a type of action system that by its nature is open-ended and ongoing. As it is how we maintain our relationships, it serves the purpose of allowing us to always resume interaction. And provides means by which to handle the gaps in between. Social tools, then, are built on action systems that are open-ended. They have no ending or conclusion, and are literally never finished. (Which is why it’s not really stories, but narration, which best describes social sharing activity.)

Given that communication wants to be probable, and given that mediation makes communication improbable, social tools use features and action designs that increase probabilities of communication. The Like, the retweet, the vote, and even the follow are system elements that serve as proxy communication. They are indirect symbolic expressions and actions. Same for all, but meaning something unique to each user each and every time they are used. These symbolic social actions in other words enable communication by other means: technical means, symbolic means, and within a social system that has ways of presenting these social actions to others.

Because these social systems are networked, any action taken that is captured and represented by technical form (like button click > “username liked this”) is displayed to others (a user’s friends), according to context (feed, page, etc). This leaves us with something very unique. A form or medium of communication quite different from the directly coupled ancestor of the phone, or the broadcast ancestor of radio and television. This unique property is distribution: propagation of a social action throughout the medium, if you will, according to “sharing,” display, privacy, and other design rules baked into the social system’s logic (just think Facebook timeline).

We saw earlier that the residual feature of social action is the appeal; the unspoken, if you will, of all that is said. Now this is complexified. For mediated symbolic action has a functional dualism: it appeals, and it propagates (distribution). Here we have the fundamental amplification of social media: a social action taken is visible (heard) in many “places.” It is a kind of action dislocated from space and place, and instead reproduced by system logic and rules in “contexts” “elsewhere.”

Now given that all social action seeks acknowledgement (directly or indirectly), mediated social action is split in two. The appeal is split from the action itself. For each additional context in which a social action is represented (say, a Like that appears in many friends’ feeds, on pages, in notifications, on phones, etc), its author’s intent is lost. For it’s a given that the author has not intended to “like” in front of each of his or her friends, to be seen in their feeds, or notified on their phones. A new form of communication is thus born — and all users must develop skills and competencies with which to interpret and handle what their friends mean, as well as what’s going on.

The dual function of the symbolic social action, an appeal split from propagation of the action’s represented form, complicates communication further. For there is but one possibility for communication as a kind of social action, and it is the response. But responses no longer mean what they did, when communication is unmediated and direct (as between people talking face to face). Furthermore, any response is itself a new social action, itself now with an appeal, and itself now propagated to contexts elsewhere.

And so we have the second ingredient of our secret sauce: distribution. We are far from the feedback loop. For we have neither the closure nor the recycling that make up feedback. Rather, we have a much less efficient system of communication. What might be considered noise. And not just the noise “generated” by the propagation of social actions, but the meta noise, if you will, of all the lost intentional signals.

Which is where design comes in. Design of social must answer to the needs and interests of social action, not just the needs and interests of individual users. But social architecture has a growing portfolio of plans and blueprints at its disposal. And accompanied with an understanding of the dynamics of social activities, a sense for how to lay out social designs for increasing complexity over time.

Closure, still, is the first order of business in social interaction design. Closure makes communication more probable. In so doing, it decreases noise (noise being a form of redundancy). And so the social interaction designer asks not “what feedback loops do we build into this?” but “how do we facilitate social closure through other users?”

We mentioned earlier that distance in human experience is closeness. Closure is closeness. Jimi’s guitar feedback was closeness — proximity to the amp. But as speed of feedback. And in mediated systems, because they are technologies, closeness is a factor of speed (or time, as duration). The notification increases speed. The realtime feed increases speed. Speed reduces waiting time, and accelerates the process of communication.

And so we have our third ingredient: temporality. All human affairs take time. Time not measured in minutes or hours, but felt and experienced: as tedious, dragging, plodding, or urgent, impatient, distracted time. Time has stretches, and spans; it has rhythms, cycles, and repetitions. It becomes habit, and pastime. And is lost in distraction, ephemera, and its own passage. Time, as we know it, has past and future. As past, it is recollection; as future, it is anticipation and expectation. No time, in human terms, is entirely unorganized, and all time, as we experience it, has meaning.

So the real real time revolution is not the revolution of speed alone. It is the revolution of im-mediacy. Approximation, by proxy of proximity, of immediacy in mediation. Design of socio-technical systems making increasingly running claims upon our awareness and attention. In short, getting ever closer to the presence in absence of that open state of talk which is the normal condition of everyday life.

Now many social systems designers have gone at the abstraction of social into design forms and rules. Gamification is one example of something interesting gone badly wrong at the hands of abstraction. Game mechanics, too, are oft but a shell of something compelling dislocated from the eventfulness of games and reified into codified sets of rules and recommendations. Design like this gets nowhere close to the grist because it takes its abstractions as real. Soon the map precedes the territory.

Designing for social makes use of much simpler factors. All social action appeals to others. All social action communicates. All communication is coupling. People understand the appeal of social action as acknowledgment. People understand the action of communication as response. People engage in communication through reciprocity and reciprocal action. All occurs over time, in order, and the more synchronous the experience the more present it feels.

To design social tools you need only to understand the distance at which you operate from the realities of human experience.

Posted in Design, Social practices, SxD Theory, UX | View Comments