Skip to main content

Responsibility Matrix - LLMaaS

Here is the RACI for the shared responsibility between the client and Cloud Temple for the use of the LLM as a Service (LLMaaS) platform.

Definition of the different roles

We remind you here of the different RACI roles:

RoleDescription
(R) Responsible__R__esponsible for the process
(A) Approves__A__pproves the process execution
(C) Consulted__C__onsulted during the process
(I) Informed__I__nformed of the process results

Define your requirements

ActivityClient RoleCloud Temple Role
Validate that the LLMaaS service meets the application requirementsRACI
Subscribe to the service and select a billing tierRAI

Implement the Service

ActivityClient RoleCloud Temple Role
Ensure operational readiness of the LLMaaS platform (API, GPU)IRA
Ensure security readiness of the LLMaaS platformIRA
Manage API access keys (creation, rotation, revocation)RA
Develop and maintain the client application codeRA

Recurring Operations

ActivityClient RoleCloud Temple Role
Ensure LLMaaS API availabilityIRA
Monitor platform and model operationIRA
Manage LLMaaS platform incidentsIRA
Manage LLMaaS platform problemsIRA
Manage GPU infrastructure capacityIRA
Manage model updates (additions, deprecations)C, IRA
Track consumption and billingRAI

Security Management

ActivityClient RoleCloud Temple Role
Secure physical infrastructure and LLMaaS platformIRA
Manage access and permissions for application end usersRA
Secure data and prompts sent to the APIRAC
Ensure confidentiality of data processed by modelsRA
Manage compliance of the final application (GDPR, etc.)RAI

Business Continuity

ActivityClient RoleCloud Temple Role
Ensure business continuity of the LLMaaS platformIRA
Ensure backup of client application dataRA
Maintain the business continuity plan for the client applicationRA

Reversibility

ActivityClient RoleCloud Temple Role
Implement the reversibility project (planning, tools, targets)RAC
Export the client application's data and codeRA
Delete API keys and service accessRA