Session Management

Session management provides comprehensive tracking and control over GDPR data cleaning operations. Each cleaning operation is organized into sessions that provide audit trails and operational control.

Session Overview

What is a Session?

A session represents a single data cleaning operation or a group of related cleaning operations performed together. Sessions provide: - Operational Control: Start, stop, and monitor cleaning operations - Audit Trail: Complete record of what was cleaned, when, and by whom - Error Management: Tracking and resolution of cleaning failures - Performance Monitoring: Statistics on cleaning operation efficiency

Session Lifecycle

Created → In Progress → Completed/Failed
    ↓         ↓             ↓
 Queued   Processing    Archived

Session Types

Manual Sessions

Purpose: Interactive data cleaning initiated by users Characteristics: - Started from GDPR Register List or table pages - Real-time user interaction and monitoring - Immediate feedback on progress and errors - User can cancel or modify operation mid-process

Batch Sessions

Purpose: Large-scale automated cleaning operations Characteristics: - Scheduled or triggered cleaning operations - Background processing without user interaction - Designed for high-volume data processing - Automatic retry and error handling

Test Sessions

Purpose: Validation and testing of cleaning parameters Characteristics: - Run in simulation mode without actually cleaning data - Validate filters and field selections - Estimate processing time and resource usage - Generate reports on what would be cleaned

Session Creation and Management

Creating a New Session

From GDPR Register List

  1. Navigate to Register: Open GDPR Register List page
  2. Select Elements: Choose data elements to clean
  3. Start Session: Use Actions > Clean Data
  4. Configure Session:
    • Session Name: Descriptive name for the operation
    • Description: Purpose and scope of cleaning
    • Priority: High, Normal, or Low processing priority

Manual Session Configuration

Session Name: Customer Data Cleanup - Q1 2026
Description: Remove inactive customer data older than 7 years
Priority: Normal
Estimated Records: 1,250 customers
Estimated Duration: 45 minutes

Session Properties

Basic Information

  • Session ID: System-generated unique identifier
  • Session Name: User-defined descriptive name
  • Created By: User who initiated the session
  • Created Date/Time: When session was created
  • Status: Current session state

Processing Information

  • Start Date/Time: When processing began
  • End Date/Time: When processing completed
  • Duration: Total processing time
  • Progress: Percentage of operation completed

Statistics

  • Total Records: Number of records targeted for processing
  • Processed Records: Number of records actually processed
  • Successful Operations: Number of successful field cleaning operations
  • Failed Operations: Number of failed cleaning operations
  • Error Rate: Percentage of operations that failed

Session Status Management

Session States

Created

  • Description: Session exists but hasn't started processing
  • Actions Available: Edit configuration, start processing, delete session
  • User Actions: Modify filters, change field selections, update priority

In Progress

  • Description: Session is actively processing data
  • Actions Available: Monitor progress, cancel operation
  • System Actions: Update progress indicators, log operations, handle errors

Completed

  • Description: Session finished successfully
  • Actions Available: View results, export logs, archive session
  • Cleanup Actions: Generate completion reports, notify stakeholders

Failed

  • Description: Session stopped due to critical error
  • Actions Available: Review errors, restart session, modify configuration
  • Recovery Actions: Fix underlying issues, retry operations

Cancelled

  • Description: User or system cancelled the session
  • Actions Available: Review partial results, restart with different parameters
  • Audit Actions: Document cancellation reason, assess partial results

Status Transitions

Created → In Progress: User starts session or scheduler activates
In Progress → Completed: All operations finish successfully  
In Progress → Failed: Critical error stops processing
In Progress → Cancelled: User or system cancels operation
Failed → Created: Session reset for retry
Cancelled → Created: Session reset for restart

Session Monitoring

Real-Time Monitoring

Progress Indicators

  • Overall Progress: Percentage of total operation completed
  • Current Operation: Which table/field is being processed
  • Processing Rate: Records per minute or operations per second
  • Time Estimates: Estimated time to completion

Live Statistics Display

Session: Customer Data Cleanup - Q1 2026
Status: In Progress (67% complete)
Current: Processing Customer.E-Mail field
Records: 837 of 1,250 processed
Success Rate: 98.2% (823 successful, 14 failed)
Estimated Complete: 14:35 (in 12 minutes)

Error Monitoring

  • Error Count: Real-time count of failed operations
  • Error Types: Classification of error causes
  • Recent Errors: Display of most recent error messages
  • Error Rate Trends: Whether error rate is increasing or stable

Session Logs

Session-Level Logging

  • Session Events: Start, stop, pause, resume operations
  • Configuration Changes: Modifications to session parameters
  • System Events: Resource usage, performance metrics
  • User Actions: Manual interventions during processing

Operation-Level Logging

  • Field Operations: Each individual field cleaning operation
  • Success/Failure: Outcome of each operation
  • Error Details: Specific error messages and codes
  • Timing Information: Duration of each operation

Advanced Session Features

Session Templates

Creating Templates

  1. Configure Standard Session: Set up commonly used filters and field selections
  2. Save as Template: Export configuration for reuse
  3. Template Naming: Use descriptive names for easy identification
  4. Documentation: Document template purpose and usage guidelines

Using Templates

  1. Select Template: Choose from list of available templates
  2. Customize Parameters: Modify dates, filters, or other criteria
  3. Validate Configuration: Review and test before execution
  4. Execute Session: Run with template-based configuration

Session Scheduling

Automated Sessions

  • Time-Based: Schedule sessions for specific dates/times
  • Event-Based: Trigger sessions based on business events
  • Recurring: Set up regular cleaning operations
  • Conditional: Execute only when certain conditions are met

Schedule Management

Schedule: Monthly Inactive Customer Cleanup
Frequency: First Monday of each month at 2:00 AM  
Condition: Only if inactive customers > 100
Template: Customer Cleanup Template
Notification: Email results to GDPR team

Session Collaboration

Multi-User Sessions

  • Session Sharing: Multiple users can monitor same session
  • Role-Based Access: Different permission levels for session access
  • Collaborative Monitoring: Team-based session oversight
  • Handoff Procedures: Transfer session ownership between users

Approval Workflows

  • Review Required: Sessions requiring manager approval
  • Approval Process: Multi-step approval for sensitive data
  • Escalation: Automatic escalation for high-risk operations
  • Documentation: Full audit trail of approval decisions

Session Troubleshooting

Common Session Issues

Session Won't Start

  • Permission Issues: Verify user has required permissions
  • Resource Constraints: Check system resources and concurrent sessions
  • Configuration Errors: Validate filters and field selections
  • Data Locks: Ensure target data isn't locked by other processes

Session Performance Problems

  • Slow Processing: Optimize filters to reduce data volume
  • High Error Rate: Review error patterns and fix underlying issues
  • Resource Usage: Monitor CPU, memory, and database performance
  • Concurrent Operations: Limit simultaneous sessions if needed

Session Interruption

  • Network Issues: Handle network connectivity problems
  • System Maintenance: Manage sessions during system updates
  • User Interruption: Handle user cancellation gracefully
  • Recovery Procedures: Restart interrupted sessions safely

Error Resolution

Systematic Error Analysis

  1. Error Classification: Group errors by type and cause
  2. Root Cause Analysis: Identify underlying system issues
  3. Solution Development: Create fixes for common error patterns
  4. Prevention: Update processes to prevent recurring errors

Error Recovery

  • Partial Recovery: Complete successful operations, retry failures
  • Full Restart: Reset session and restart from beginning
  • Alternative Approach: Modify configuration to avoid problematic data
  • Manual Intervention: Hand-clean problematic records

Best Practices

Session Planning

  • Scope Definition: Clearly define what each session will accomplish
  • Resource Planning: Ensure adequate system resources available
  • Timing Coordination: Schedule sessions during appropriate time windows
  • Impact Assessment: Understand business impact of cleaning operations

Session Documentation

  • Purpose Documentation: Record business justification for each session
  • Configuration Records: Maintain details of session parameters
  • Results Documentation: Document outcomes and lessons learned
  • Audit Preparation: Ensure session records support compliance audits

Performance Optimization

  • Batch Sizing: Optimize record batch sizes for your environment
  • Filter Efficiency: Use efficient filters to minimize data processing
  • Resource Monitoring: Monitor and optimize system resource usage
  • Concurrent Sessions: Manage multiple sessions to avoid conflicts

Next Steps

After mastering session management:

  1. Supported Versions: Check compatibility information
  2. Integration Overview: Learn about automation options
  3. Troubleshooting: Get help with common issues