You need to train a computer vision model that predicts the type of government ID present in a given image using a GPU-powered virtual machine on Compute Engine. You use the following parameters:
* Optimizer: SGD
* Image shape 224x224
* Batch size 64
* Epochs 10
* Verbose 2
During training you encounter the following error: ResourceExhaustedError: out of Memory (oom) when allocating tensor. What should you do?
The best option to minimize storage and computational overhead is to use the TRANSFORM clause in the CREATE MODEL statement in the SQL query to calculate the required statistics. The TRANSFORM clause allows you to specify feature preprocessing logic that applies to both training and prediction. The preprocessing logic is executed in the same query as the model creation, which avoids the need to create and store intermediate tables. The TRANSFORM clause also supports quantile bucketization and MinMax scaling, which are the preprocessing steps required for this scenario. Option A is incorrect because creating a component in the Vertex AI Pipelines DAG to calculate the required statistics may increase the computational overhead, as the component needs to run separately from the model creation. Moreover, the component needs to pass the statistics to subsequent components, which may increase the storage overhead. Option B is incorrect because preprocessing and staging the data in BigQuery prior to feeding it to the model may also increase the storage and computational overhead, as you need to create and maintain additional tables for the preprocessed data. Moreover, you need to ensure that the preprocessing logic is consistent for both training and inference. Option C is incorrect because creating SQL queries to calculate and store the required statistics in separate BigQuery tables may also increase the storage and computational overhead, as you need to create and maintain additional tables for the statistics. Moreover, you need to ensure that the statistics are updated regularly to reflect the new data.Reference:
Feature preprocessing with BigQuery ML
Andra
3 months agoErnie
4 months agoShantell
4 months agoLisha
4 months agoOdette
4 months agoGlendora
4 months agoVernell
5 months agoSharen
5 months agoBilly
5 months agoBen
5 months agoMaryln
5 months agoEnola
5 months agoMona
5 months agoAdelina
5 months agoSylvie
10 months agoXenia
10 months agoAnnamae
10 months agoThaddeus
10 months agoLindsey
11 months agoGaston
9 months agoShawnta
9 months agoFletcher
10 months agoGayla
10 months agoMammie
11 months agoReita
11 months agoThad
11 months agoGarry
9 months agoLaurel
9 months agoNorah
9 months agoVal
9 months agoBulah
9 months agoLisbeth
9 months agoTijuana
10 months agoEvelynn
10 months agoParis
11 months agoMargurite
11 months agoCasey
11 months ago