Code development platform for open source projects from the European Union institutions :large_blue_circle: EU Login authentication by SMS has been phased out. To see alternatives please check here

Skip to content
Snippets Groups Projects
Commit 9a6db795 authored by Gilles Habran's avatar Gilles Habran
Browse files

Merge branch 'AITED-131_use-latest-improvements' into 'main'

AITED-131: use latest improvements

See merge request !2
parents 63f1747b 029fe10c
Branches
Tags
1 merge request!2AITED-131: use latest improvements
Pipeline #100363 failed
{
"c_param": "15"
"c_param": "15.25"
}
......@@ -64,7 +64,7 @@ def train(input_data_path: str, model_save_path: str, hyperparams_path: str = No
raw_data = [pd.read_csv(file, index_col=0, engine="python") for file in input_files]
df = pd.concat(raw_data)
print(f"Full dataset contains {len(df.index)} records.")
train_df, test_df = train_test_split(df, test_size=0.2)
train_df, test_df = train_test_split(df, test_size=0.1)
x_train = train_df['title_texte']
y_train = train_df.drop(['title_texte'], axis=1)
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Please register or to comment