9 Commits

Author SHA1 Message Date
e5ecb714ba Refactor loss computation and model input handling for improved clarity and efficiency 2026-06-20 11:26:03 +08:00
1ea72e9133 Refactor DeepHealth model to expand extra-info token handling and update output structure 2026-06-17 14:27:07 +08:00
1757bcd25b Refactor DeepHealth model and related components
- Removed BaselineEncoder and CrossAttention classes from models.py.
- Introduced OtherInfoTokenizer for handling additional token types.
- Updated DeepHealth class to integrate OtherInfoTokenizer and manage extra pooling logic.
- Added support for extra_pool_reduce parameter to control pooling behavior.
- Modified forward methods to return structured output using DeepHealthOutput dataclass.
- Updated training scripts to accommodate changes in model architecture and output handling.
- Enhanced error handling and validation for input shapes and types.
2026-06-17 11:05:10 +08:00
36ec36c8a8 Add time attention mask handling and baseline class time computation to DeepHealth model 2026-06-15 14:35:10 +08:00
c3e49db859 Enhance DeepHealth model to incorporate CHECKUP state tokens in next-step training and evaluation, update dataset cache versioning, and improve handling of observed event histories. 2026-06-15 14:10:09 +08:00
593ecd2e71 Revert cross-attention integration into GPTBlock 2026-06-15 10:05:13 +08:00
c87c3b9f7c Add cross-attention support to GPTBlock and update DeepHealth model integration 2026-06-13 17:02:04 +08:00
0fa8bbbb9a Enhance data parsing and validation, add extra info types files
- Improved `parse_int_list` and `parse_float_list` functions to support JSON list input.
- Introduced `validate_dataset_metadata` function to ensure dataset metadata consistency with training configuration.
- Added multiple new files for extra information types, categorizing them into assessment-only, exposure-only, and combined types.
- Removed deprecated `merge_extra_info_types` function and adjusted related logic in `train.py`.
- Updated `save_config` function to accept additional metadata for training runs.
- Refactored model and training scripts for better clarity and maintainability.
2026-06-12 11:16:19 +08:00
5e979e061b Add target construction and training script for DeepHealth model
- Implemented target construction in `targets.py` for next-token and unique-time set supervision.
- Added validation functions and utility methods for target building.
- Created a comprehensive training script in `train.py` that includes data loading, model building, optimizer setup, and training loop with early stopping and logging.
- Integrated loss functions and readout mechanisms based on target modes.
- Established dataset splitting and DataLoader configurations for training, validation, and testing.
2026-06-12 10:28:16 +08:00