Close

Presentation

Large Genomic Language Models: Towards Their Hyperparameter Optimization
DescriptionThis study explores hyperparameter optimization for encoder-only genomics large language models, balancing machine learning performance, hardware resource usage and power consumption. Multiple search techniques and objective functions were implemented, and from the results we obtained two types of models: a Compact and an Optimal model. Comprehensive tests were carried out to rank these models based on their model performance and resource usage.