Dağlier, Y.Ekici, B.Korkmaz, K.2026-01-252026-01-25202597894912071369789491207105978949120712997809541183969789491207358978949120705197809541183729789491207235978949120738997894912072282684-1843https://hdl.handle.net/11147/18894Bentley Advancing Infrastructure; POLARKON; TUBITAKUtilizing artificial intelligence (AI) methods in the design process supports the achievement of sustainable alternatives during the conceptual design. In various AI methods, optimization and machine learning (ML) algorithms are the most common methods to develop predictive models and discover favorable design alternatives with significantly reduced computational time. Recent works focused on limited datasets, as well as the evaluation of the developed prediction models based on collected data. During the optimization process of complex design problems, the number of design parameters becomes enormous; thus, search areas contain many design alternatives that might lead the search outside of the collected data. Therefore, evaluating the accuracy of prediction models only based on the collected samples may result in scenarios where the predicted outcome during the optimization process aligns with an unrealistic solution. This study investigates how accurately prediction models developed using different ML algorithms can perform in optimization processes. The proposed framework is used to cope with outdoor thermal performance, considering kinetic shading devices with rigid origami techniques. A parametric shading device model with kinematic principles and 10 design parameters is created in Grasshopper 3d. LadyBug is used to analyze the performance of the universal thermal climate index (UTCI). To minimize the UTCI, the radial basis function optimization (RBFOpt) algorithm in the Opossum plugin is used. To compare the optimization results with the prediction results, multiple linear regression, support vector machines, random forest, polynomial regression algorithms, and artificial neural networks (ANN) are developed to predict outdoor thermal comfort performance targets on each collected data set with 2000 samples. Results showed that ANN models can provide more accurate predictions during the optimization process. The paper aims to discuss the way ML algorithms are applied and evaluated for ML-based optimization domains in design problems. © 2025, Education and research in Computer Aided Architectural Design in Europe. All rights reserved.eninfo:eu-repo/semantics/closedAccessArtificial Neural NetworkKinetic Shading DevicesMachine LearningOptimizationUniversal Thermal Climate IndexConference Object2-s2.0-105026170058