Posts Tagged ‘information systems’
In a recent post Haowen Chan and Robin Morris warn “the last thing you want to do is implement a [big data] system that develops and propagates data, only to learn it’s hopelessly biased.” All research and analysis has bias built in by the very nature of human involvement. However Chan and Morris provide four useful bias-quelling tactics that can be used to improve the big data science process:
- Employ domain experts Rely on them to help select relevant data and explore which features, inputs and outputs produce the best results. If heuristics are used to gain insights into smaller data sets, the data scientist will work with the domain expert to test the heuristics and ensure they actually produce better results. Like a pitcher and catcher in a baseball game, they are on the same team, with the same goal, but each brings different skill sets to complementary roles.
- Look for white spaces Data scientists who work with one data set for periods of time risk complacency, making it easier to introduce bias that reinforces preconceived notions. Don’t settle for what you have; instead, look for the “white spaces” in your data sets and search for alternate sources to supplement “sparse data.”
- Open a feedback loop This will help data scientists react to changing business requirements with modified models that can be accurately applied to the new business conditions. Applying Lean Startup like continuous delivery methodologies to your big data approach will help you keep your model fresh.
- Encourage your data scientists to explore. If you can afford your own team of data scientists, be sure they have the space and autonomy to explore freely. Some equate big data to the solar system, so get out there and explore this uncharted universe!
We can also consider what bias we are encouraging when we develop systems – from social media plugins to smart objects – which collect ‘big data,’ or data which could be aggregated into big data analysis. Might we be unfairly representing a picture from our data subjects, either by representation or omission? Collection, processing and analysis are all crucial to consider in the quest for useful and accurate big data outcomes.
United Nations Secretary-General Ban Ki-moon has delivered a five year action plan for the UN entitled “The Future We Want,” elaborating on high level goals set out last year (and sharing directly with the world on Twitter).
Here are some key points from an information society perspective:
- Technology continues to knit us more closely together… Yet, economic uncertainty and social inequity are widespread.
- We are… preparing to empower future generations by offering quality, relevant and universal education to meet the challenges of the 21st century.
- On conflict, my agenda highlights early warning and action on conflict by mapping, linking, collecting and integrating information from across the international system.
- We will also adopt a preventive approach to human rights. The era of impunity is dead. We have entered a new age of accountability.
- When events slip off the front page, when the cameras leave, the UN must be ready to maintain focus and attention.. We have a responsibility to help societies in transition… we will support “transition compacts” with agreed strategic objectives and mutual accountability in fragile and conflict environments.
- We will do even more to promote women’s political participation worldwide
- Today we have the largest generation of young people the world has ever known. They are demanding their rights and a greater voice in economic and political life.
- We will harness the full power of transformative partnership across the range of UN activities by creating a New UN Partnerships Facility. It will work with the private sector, civil society, philanthropists and academia to advance common goals, catalyze commitments and promote accountability.
Appreciative Inquiry is a particular way of asking questions and envisioning the future that fosters positive relationships and builds on the basic goodness in a person, a situation, or organization proponents. In so doing, it enhances a system’s capacity for collaboration and change