Case Study 1: Professional Accountant in Business – AI-Generated Strategy and Planning
As time is short, you decide to use the free version of a widely available AI tool to assist with the task. You prompt the AI system to “produce a company three-year strategy and one-year business plan for a manufacturing business in our sector.” You ask your finance team to input previous company reports, financial data, market analyses, and all relevant company material into the system.
The AI produces an impressive-looking document with sophisticated charts, metrics, and strategic recommendations. The CEO is initially delighted with the professional presentation and comprehensive nature of the plan.
However, on re-reading the document the night before your presentation to the board, you notice several concerning elements:
- The AI has recommended significant staff reductions and outsourcing manufacturing operations to a country with an authoritarian regime, citing potential cost savings of 40%.
- The recommended country is designated by the Financial Action Task Force and your national Treasury as a High-Risk AML jurisdiction and has a poor record on human rights.
- Some of the financial projections appear overly optimistic when compared to your industry knowledge and experience.
- The AI has made specific recommendations about competitors that appear to be based on non-public information, though you’re unsure how the AI would have accessed this information.
- The document contains several references to internal company data that are commercially sensitive.
Ethical Considerations
Possible Course of Action
- Disclose the use of AI: Be transparent with the CEO and the board about how the draft strategy was developed, including the use of AI and the limitations of the technology.
- Address data privacy concerns: Consult with the company’s data protection officer or legal counsel regarding the implications of uploading company data to the AI platform, and ensure compliance with relevant data protection legislation.
- Apply professional judgement: Critically evaluate the AI-generated recommendations based on your professional knowledge and experience, particularly those related to staff reductions and outsourcing to high-risk jurisdictions.
- Conduct a comprehensive risk assessment: Evaluate the ethical, legal, reputational, and operational risks associated with the AI recommendations, particularly regarding the suggested outsourcing to a high-risk jurisdiction.
- Revise the strategy document: Modify the draft to ensure it aligns with the company’s values, ethical standards, and legal obligations. Remove any recommendations that could potentially violate sanctions or ethical business practices.
- Implement proper AI governance: Work with relevant stakeholders to develop protocols for the future use of AI in strategic decision-making, including clear guidelines on data usage, human oversight, and ethical considerations.
- Document your decision-making process: Maintain records of your assessment, the concerns identified, and the actions taken to address them, to demonstrate your diligence and professional judgement.
- Acknowledge the use of AI as a tool to assist in drafting the strategy, but emphasise that the final recommendations have been subject to professional review and judgement.
- Highlight specific areas where you modified the AI outputs based on ethical considerations (linked to the fundamental principles) and your professional expertise.
- Recommend that the company develop a formal AI governance framework to guide the ethical use of AI technologies throughout the organisation, ensuring that future AI applications align with the company’s values and ethical standards.