Responsibility Matrix - LLMaaS
Here is the RACI for the shared responsibility between the client and Cloud Temple for the use of the LLM as a Service (LLMaaS) platform.
Definition of the different roles
We remind you here of the different RACI roles:
| Role | Description |
|---|
| (R) Responsible | __R__esponsible for the process |
| (A) Approves | __A__pproves the process execution |
| (C) Consulted | __C__onsulted during the process |
| (I) Informed | __I__nformed of the process results |
Define your requirements
| Activity | Client Role | Cloud Temple Role |
|---|
| Validate that the LLMaaS service meets the application requirements | RA | CI |
| Subscribe to the service and select a billing tier | RA | I |
Implement the Service
| Activity | Client Role | Cloud Temple Role |
|---|
| Ensure operational readiness of the LLMaaS platform (API, GPU) | I | RA |
| Ensure security readiness of the LLMaaS platform | I | RA |
| Manage API access keys (creation, rotation, revocation) | RA | |
| Develop and maintain the client application code | RA | |
Recurring Operations
| Activity | Client Role | Cloud Temple Role |
|---|
| Ensure LLMaaS API availability | I | RA |
| Monitor platform and model operation | I | RA |
| Manage LLMaaS platform incidents | I | RA |
| Manage LLMaaS platform problems | I | RA |
| Manage GPU infrastructure capacity | I | RA |
| Manage model updates (additions, deprecations) | C, I | RA |
| Track consumption and billing | RA | I |
Security Management
| Activity | Client Role | Cloud Temple Role |
|---|
| Secure physical infrastructure and LLMaaS platform | I | RA |
| Manage access and permissions for application end users | RA | |
| Secure data and prompts sent to the API | RA | C |
| Ensure confidentiality of data processed by models | R | A |
| Manage compliance of the final application (GDPR, etc.) | RA | I |
Business Continuity
| Activity | Client Role | Cloud Temple Role |
|---|
| Ensure business continuity of the LLMaaS platform | I | RA |
| Ensure backup of client application data | RA | |
| Maintain the business continuity plan for the client application | RA | |
Reversibility
| Activity | Client Role | Cloud Temple Role |
|---|
| Implement the reversibility project (planning, tools, targets) | RA | C |
| Export the client application's data and code | RA | |
| Delete API keys and service access | RA | |