# Analysis and Applicability of Results Figure 6. (a) Defining input parameters for the tensile strength temperature dependency modelFigure 6. (a) Defining input parameters for the tensile strength temperature dependency modelCopious datasets provide a possibility for comprehensive and unbiased testing of the obtained ML models with data that they haven’t been previously exposed, the same way as it normally would occur in any engineering application. Figure 4 presents the testing results for the TabNet model for the tensile strength temperature dependency for a wide range of 687 titanium alloys, where percentage of titanium varies from 55.3 to 99.8%. While testing results and quality parameters differ from model to model and from property to property, the accuracy achieved in the terms of Mean Absolute Percentage Error (MAPE) has a median value of 4 to 5%, while correlation coefficient R2 is in most cases above 90%, and frequently above 95%. While absolute accuracy and certainty can never be guaranteed, the achieved levels are generally acceptable for most engineering applications and CAE simulations. They are comparable with other data sources that are being frequently used by engineers, such as producers’ specifications and curated data collections, and generally demonstrate higher accuracy than MMPDS B-Basis values, which are used in aerospace industry \[13[^1]].

Figure 4. Results of Tabnet model for the tensile strength temperature dependency of titanium alloys using (a) regular and (b) extended dataset

Beside testing of accuracy, model quality assurance includes various other metrics and considerations: applicability domain, sensitivity analysis, feature importance, explainability and confidence intervals at the datapoint level (Figure 5).

Figure 5. a) Sensitivity analysis of temperature effect on the heat capacity of aluminum alloys; b) Feature importance for thermal expansion of copper alloys; c) Features contributions to 50 predictions for the elastic modulus of titanium alloys (TabNet) d) Confidence intervals for shear modulus of stainless steels.

For successful applicability of these models, they need to be integrated with an interface that is efficient and easy to use for the engineer. This has been implemented through Total Materia Predictor, a specialized product within the Total Materia family \[5[^2]], where the user can simply select a material or chemical composition, define the mechanical or physical property to be modeled and optionally add some other inputs such as product and heat treatment. As a result, modeled values of the property are obtained, together with all relevant parameters of the quality of the model, Figure 6. Once obtained, the property points can be simply exported to Excel and then used further. Alternatively, by using tools within Total Materia such as Console, they can be saved, comparted with other materials or conditions, formatted into a report, shared and exported directly into a CAE solver of choice.

Figure 6. (a) Defining input parameters for the tensile strength temperature dependency model

Figure 6. (c) Model results for the tensile strength temperature dependency for an aluminum alloy with 99% confidence interval

[^1]: Metallic Materials Properties Development and Standardization (MMPDS) Handbook - 17, Battelle Memorial Institute, 2022 [^2]: Total Materia AG: [www.totalmateria.com](http://www.totalmateria.com), accessed July 2022 --- # Agent Instructions: Querying This Documentation If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question. Perform an HTTP GET request on the current page URL with the `ask` query parameter: ``` GET https://docs.totalmateria.com/predictor/predictor-2-whitepaper/analysis-and-applicability-of-results.md?ask= ``` The question should be specific, self-contained, and written in natural language. The response will contain a direct answer to the question and relevant excerpts and sources from the documentation. Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.