Responsible Computing Research Report

A Consensus Study Report

Earlier this year (2022) The committee on Responsible Computing Research of the National Academies of Sciences, Engineering and Medicine in the USA published a Consensus Study Report entitled Fostering Responsible Computing Research, Foundations and

The Committee members predominantly came from US universities (with one representative from Australia), but also included representatives from Microsoft, Google and the Carnegie Endowment for International Peace. It is a 100 page document, but the following conclusions and recommendations are all to be found in the summary.

Conclusions

The process led to the committee coming to three conclusions that underpin the report recommendations:  

Conclusion 1. To be responsible, computing research needs to expand to include consideration of ethical and societal impact concerns and determination of effective ways to address them.

Conclusion 2. To be responsible, computing research needs to engage the full spectrum of stakeholders and deploy rigorous methodologies and frameworks that have proven effective for identifying the complicated social dynamics that are relevant to these ethical and societal impact concerns.

Conclusion 3. For computing technologies to be used responsibly, governments need to establish policies and regulations to protect against adverse ethical and societal impacts. Computing researchers can assist by revealing limitations of their research results and identifying possible adverse impacts and needs for government intervention.

Recommendations

Recommendation 1. The computing research community should reshape the ways computing research is formulated and undertaken to ensure that ethical and societal consequences are considered and addressed appropriately from the start.

Recommendation 2. The computing research community should initiate projects that foster responsible computing research, including research that leads to societal benefits and ethical societal impact and research that helps avoid or mitigate negative outcomes and harms. Both research sponsors and research institutions should encourage and support the pursuit of such projects.

Recommendation 3. Universities, scientific and professional societies, and research and education sponsors should support the development of the expertise needed to integrate social and behavioral science and ethical thinking into computing research.

Recommendation 4. Computing research organizations—working with scientific and professional societies and research sponsors—should ensure that their computing faculty, students, and research staff have access to scholars with the expertise to advise them in examining potential ethical and societal implications of proposed and ongoing research activities, including ways to engage relevant groups of stakeholders. Computing researchers should seek out such advice.

Recommendation 5. Sponsors of computing research should require that ethical and societal considerations be interwoven into research proposals, evaluated in proposal review, and included in project reports.

Recommendation 6. Scientific and professional societies and other publishers of computing research should take steps to ensure that ethical and societal considerations are appropriately addressed in publications. The computing research community should likewise take steps to ensure that these considerations are appropriately addressed in the public release of artifacts.

Recommendation 7. Computing researchers who are involved in the development or deployment of systems should adhere to established best practices in the computing community for system design, oversight, and monitoring.

Recommendation 8. Research sponsors, research institutions, and scientific and professional societies should encourage computing researchers to engage with the public and with the public interest and support them in doing so.

All of which makes perfect sense, so why not take a look at the report yourself? There is lots of stuff about bias in data sets and other issues that we have addressed previously and It’s free to download here.

And take a look at what Mozilla have been doing here.

Responsibility-by-design

Throughout last year I worked on a European Standard called CWA 17796 Responsibility-by-design – Guidelines to develop long-term strategies (roadmaps) to innovate responsibly, for the CEN. It is now available to download and use.

CEN is an association that brings together the National Standardization Bodies of 34 European countries, providing a platform for the development of European Standards and other technical documents in relation to various kinds of products, materials, services and processes.

This is what they say about themselves: The CEN works together with national standards bodies to create documents established by consensus and approved by a recognized body that provide, for common and repeated use, rules, guidelines or characteristics for activities or their results, aimed at the achievement of the optimum degree of order in a given context.

This document is a workshop agreement that provides guidelines to develop long-term strategies (roadmaps) for innovating responsibly, thereby helping organizations to achieve socially desirable outcomes from their innovation processes. The roadmaps encourage a “responsibility-by-design” approach that integrates considerations of technical, ethical, social, environmental, and economic aspects all along the research, development, and design process leading to an innovation.

After an introduction, the agreement offers an overview of principles for Responsible Research and Innovation, (reflection, anticipation, inclusion and responsiveness), before moving on to a section detailing the framework proposed.

The agreement closes with a series on annexes in which easy-to-interpret tables offer examples of RRI actions, tools, guideline applications, SWOT analysis for implementation in industry, tools for stakeholder analysis, methods for stakeholder engagement, criteria for impact analysis and key performance indicators before concluding with resources from other initiatives and a bibliography.

The idea is that it is a guide, offering suggestions on possible approaches that might help to make innovation strategies more responsive and responsible, following on from years of research and policy suggestions promoted by the European Commission.

Practical and not abstract, for ten Euros it can be downloaded here.

Experts, Regulation, and Food

A few weeks ago I wrote a post on the Bassetti Foundation website called The Innovation Principle.

The post was a review of a letter sent by some of Europe’s largest corporations to the European Commission. The letter claims that regulation in the EU risks damaging development and the economy, they want a series of things to be taken into account within the regulation process.

It is easy to read and short and I recommend a look, it is free to download through the link above, but I would like to take one of their suggestions and apply it to food regulation, as part of my food series.

The letter calls for the “Full inclusion of relevant expertise”, and this sounds perfectly reasonable. But what does it actually mean in practical terms?

If we take the example of GM food development that I raised last week, it means finding experts in the field and putting them on committees to determine if proposals are safe. Now this means that you have to look to industry, because most of the experts work within the industry.

Now I believe that in all likelihood an expert working for a nuclear energy company will tell you that nuclear energy production is 100% safe, a nanotechnology researcher will paint a glowing picture of how the future is bright thanks to nano developments, and a GM food expert will do the same.

In the USA, the Federal Drug Administration is responsible for regulating the safety of GM crops that are eaten by humans or animals. According to a policy established in 1992, FDA considers most GM crops as “substantially equivalent” to non-GM crops. In such cases, GM crops are designated as “Generally Recognized as Safe” under the Federal Food, Drug, and Cosmetic Act (FFDCA) and do not require pre-market approval.

But here the waters start to murk and merge. As I said, experts in the field working or having worked for industries working with technology are likely to be positive about their products. And the FDA seems to contain several of these experts, and some of them may have helped to make the distinction above.

According to this IVN article, over the last decade at least 7 high ranking FDA officials have also held high positions in Monsanto, the largest producer of GM seeds in the world. This is generally accepted as true, and in fact Monsanto have several employees present or past that have held high ranking positions in other capacities in the US Government. This is known as the revolving door in the USA, and it is worthy of exploration.

Monsanto and US Government Employees

Monsanto and US Government Employees (click to enlarge)

The website states that “At the forefront of this controversy is Michael R. Taylor, currently the deputy commissioner of the Office of Foods. He was also the deputy commissioner for Policy within the FDA in the mid ’90s. However, between that position and his current FDA position, Mr. Taylor was employed by Monsanto as Vice President of Public Policy.

Other Monsanto alumni include Arthur Hayes, commissioner of the FDA from 1981 to 1983, and consultant to Searle’s public relations firm, which later merged with Monsanto. Michael A. Friedman, former acting commissioner of the FDA, later went on to become senior Vice President for Clinical Affairs at Searle, which is now a pharmaceutical division of Monsanto (Oh Donald Rumsfeld ex Secretary of Defense was also on the Board of Directors).  Virginia Weldon became a member of the FDA’s Endocrinologic and Metabolic Drugs Advisory Committee, after retiring as Vice President for Public Policy at Monsanto”.

Another controversy surrounded the appointment of Margaret Miller. The following is taken from Red Ice Creations website:

“In order for the FDA to determine if Monsanto’s rBGH growth hormones were safe or not, Monsanto was required to submit a scientific report on that topic. Margaret Miller, one of Monsanto’s researchers put the report together. Shortly before the report submission, Miller left Monsanto and was hired by the FDA. Her first job for the FDA was to determine whether or not to approve the report she wrote for Monsanto. In short, Monsanto approved its own report. Assisting Miller was another former Monsanto researcher, Susan Sechen”.

Obviously I am not in a position to determine whether these allegations are true, but a look at this article that appeared originally in the Observer newspaper might lead one to believe that there is a fine line being walked here.

The article states that “Monsanto received copies of the position papers of the EC Director General for Agriculture and Fisheries prior to a February 1998 meeting that approved milk from cows treated with BST.

Notes jotted down by a Canadian government researcher during a November 1997 phone call from Monsanto’s regulatory chief indicate that the company ‘received the [documents] package from Dr Nick Weber’, a researcher with the US Food and Drug Administration (FDA).
Sources noted that Weber’s supervisor at the US FDA is Dr Margaret Mitchell who, before joining the agency, directed a Monsanto laboratory working on the hormone.”

Oh and the hormone treatment made the cows sick, but you can read Robert Cohen’s reported testimony before the FDA on the subject of rBGH including the disclosure that, while at the FDA and in response to increasing sickness in cows treated with the hormones, Margaret Miller increased the amount of antibiotics that farmers can legally give cows by 100 times. Once again I cannot verify the transcription but it is widely reported on the web and was apparently shown on C-Span Congress TV live.

I am not suggesting that there is any collusion here, and as Monsanto argue people move jobs, taking jobs that suit their qualifications. A look at these people’s profiles show that they have many different positions, many of which we would say were undoubtedly working for public good. But some suggest that some of their positions might lead to conflicts of interests. But if you need experts where are you going to get them from? Here though I might simply suggest that you don’t need so many experts.

Within my life’s work of trying to promote responsible innovation I have come to the conclusion that a broader public involvement within decision-making process must be a good for society. Closed sessions full of experts deciding what is or is not safe for us may be efficient in terms of getting things done, but the public’s voice is not heard, and maybe that voice could lead to more responsible choices, or at very least some reflexivity in the decision-making process.

On a closing note, arguments are currently raging in the US about the labelling of GM foods, as currently there is no need to label it, something pushed for by many organizations. There is a counter movement that is arguing that as the FDA state that there is no fundamental difference, GM products that do not contain additives should be allowed to be labelled as “natural”, in the way organic vegetables are. This Common Dreams article presents a critical view of current practices that although strongly worded offers an insight into how a section of US society thinks about the issue.

The question remains however, who do we want to regulate our food and the technology used in its production?