2025-04-01 15:18:10 - INFO - Successfully read ../output/wrds_transcript_detail.pkl.
2025-04-01 15:18:10 - INFO - Successfully read ../output/wrds_gvkey.sas7bdat.
2025-04-01 15:18:11 - INFO - Converted companyid to interger.
2025-04-01 15:18:11 - INFO - Converted keydevid to interger.
2025-04-01 15:18:11 - INFO - Converted transcriptid to interger.
2025-04-01 15:18:11 - INFO - Converted keydeveventtypeid to interger.
2025-04-01 15:18:11 - INFO - Converted transcriptcollectiontypeid to interger.
2025-04-01 15:18:11 - INFO - Converted transcriptpresentationtypeid to interger.
2025-04-01 15:18:20 - INFO - Successfully added wrds_transcript_detail to SQL database
2025-04-01 15:18:21 - INFO - None
2025-04-01 15:18:21 - INFO - Successfully added wrds_gkvey to SQL database
2025-04-01 15:18:21 - INFO - None
2025-04-01 15:25:37 - INFO - Converted transcriptid to interger.
2025-04-01 15:25:37 - INFO - Converted transcriptcomponentid to interger.
2025-04-01 15:25:37 - INFO - Converted componentorder to interger.
2025-04-01 15:25:37 - INFO - Converted transcriptcomponenttypeid to interger.
2025-04-01 15:25:37 - INFO - Converted transcriptpersonid to interger.
2025-04-01 15:25:40 - INFO - Converted transcriptpresentationtypeid to string.
2025-04-01 15:25:40 - INFO - Converted speakertypeid to interger.
2025-04-01 15:25:42 - INFO - Converted transcriptpresentationtypeid to string.
2025-04-01 15:26:26 - INFO - Successfully added wrds_transcript_person to SQL database
2025-04-01 15:26:26 - INFO - None
2025-04-01 15:31:52 - INFO - Converted transcriptid to interger.
2025-04-01 15:31:52 - INFO - Converted transcriptcomponentid to interger.
2025-04-01 15:31:52 - INFO - Converted componentorder to interger.
2025-04-01 15:31:52 - INFO - Converted transcriptcomponenttypeid to interger.
2025-04-01 15:31:52 - INFO - Converted transcriptpersonid to interger.
2025-04-01 15:31:54 - INFO - Converted transcriptpresentationtypeid to string.
2025-04-01 15:31:54 - INFO - Converted speakertypeid to interger.
2025-04-01 15:31:56 - INFO - Converted transcriptpresentationtypeid to string.
2025-04-01 15:32:35 - INFO - Successfully added wrds_transcript_person to SQL database
2025-04-01 15:32:35 - INFO - None
2025-04-01 15:37:50 - INFO - Converted transcriptid to interger.
2025-04-01 15:37:50 - INFO - Converted transcriptcomponentid to interger.
2025-04-01 15:37:50 - INFO - Converted componentorder to interger.
2025-04-01 15:37:50 - INFO - Converted transcriptcomponenttypeid to interger.
2025-04-01 15:37:50 - INFO - Converted transcriptpersonid to interger.
2025-04-01 15:37:52 - INFO - Converted transcriptpresentationtypeid to string.
2025-04-01 15:37:52 - INFO - Converted speakertypeid to interger.
2025-04-01 15:37:54 - INFO - Converted transcriptpresentationtypeid to string.
2025-04-01 15:38:33 - INFO - Successfully added wrds_transcript_person to SQL database
2025-04-01 15:38:33 - INFO - None
2025-04-01 15:43:28 - INFO - Converted transcriptid to interger.
2025-04-01 15:43:28 - INFO - Converted transcriptcomponentid to interger.
2025-04-01 15:43:28 - INFO - Converted componentorder to interger.
2025-04-01 15:43:28 - INFO - Converted transcriptcomponenttypeid to interger.
2025-04-01 15:43:28 - INFO - Converted transcriptpersonid to interger.
2025-04-01 15:43:30 - INFO - Converted transcriptpresentationtypeid to string.
2025-04-01 15:43:30 - INFO - Converted speakertypeid to interger.
2025-04-01 15:43:32 - INFO - Converted transcriptpresentationtypeid to string.
2025-04-01 15:44:08 - INFO - Successfully added wrds_transcript_person to SQL database
2025-04-01 15:44:08 - INFO - None
2025-04-01 15:48:16 - INFO - Converted transcriptid to interger.
2025-04-01 15:48:16 - INFO - Converted transcriptcomponentid to interger.
2025-04-01 15:48:16 - INFO - Converted componentorder to interger.
2025-04-01 15:48:16 - INFO - Converted transcriptcomponenttypeid to interger.
2025-04-01 15:48:16 - INFO - Converted transcriptpersonid to interger.
2025-04-01 15:48:18 - INFO - Converted transcriptpresentationtypeid to string.
2025-04-01 15:48:18 - INFO - Converted speakertypeid to interger.
2025-04-01 15:48:20 - INFO - Converted transcriptpresentationtypeid to string.
2025-04-01 15:48:54 - INFO - Successfully added wrds_transcript_person to SQL database
2025-04-01 15:48:54 - INFO - None
2025-04-01 15:53:11 - INFO - Converted transcriptid to interger.
2025-04-01 15:53:11 - INFO - Converted transcriptcomponentid to interger.
2025-04-01 15:53:11 - INFO - Converted componentorder to interger.
2025-04-01 15:53:11 - INFO - Converted transcriptcomponenttypeid to interger.
2025-04-01 15:53:11 - INFO - Converted transcriptpersonid to interger.
2025-04-01 15:53:13 - INFO - Converted transcriptpresentationtypeid to string.
2025-04-01 15:53:13 - INFO - Converted speakertypeid to interger.
2025-04-01 15:53:14 - INFO - Converted transcriptpresentationtypeid to string.
2025-04-01 15:53:49 - INFO - Successfully added wrds_transcript_person to SQL database
2025-04-01 15:53:49 - INFO - None
2025-04-01 15:57:50 - INFO - Converted transcriptid to interger.
2025-04-01 15:57:50 - INFO - Converted transcriptcomponentid to interger.
2025-04-01 15:57:50 - INFO - Converted componentorder to interger.
2025-04-01 15:57:50 - INFO - Converted transcriptcomponenttypeid to interger.
2025-04-01 15:57:50 - INFO - Converted transcriptpersonid to interger.
2025-04-01 15:57:52 - INFO - Converted transcriptpresentationtypeid to string.
2025-04-01 15:57:52 - INFO - Converted speakertypeid to interger.
2025-04-01 15:57:53 - INFO - Converted transcriptpresentationtypeid to string.
2025-04-01 15:58:27 - INFO - Successfully added wrds_transcript_person to SQL database
2025-04-01 15:58:27 - INFO - None
2025-04-01 16:02:22 - INFO - Converted transcriptid to interger.
2025-04-01 16:02:22 - INFO - Converted transcriptcomponentid to interger.
2025-04-01 16:02:22 - INFO - Converted componentorder to interger.
2025-04-01 16:02:22 - INFO - Converted transcriptcomponenttypeid to interger.
2025-04-01 16:02:22 - INFO - Converted transcriptpersonid to interger.
2025-04-01 16:02:24 - INFO - Converted transcriptpresentationtypeid to string.
2025-04-01 16:02:24 - INFO - Converted speakertypeid to interger.
2025-04-01 16:02:25 - INFO - Converted transcriptpresentationtypeid to string.
2025-04-01 16:02:58 - INFO - Successfully added wrds_transcript_person to SQL database
2025-04-01 16:02:58 - INFO - None
2025-04-01 16:07:06 - INFO - Converted transcriptid to interger.
2025-04-01 16:07:06 - INFO - Converted transcriptcomponentid to interger.
2025-04-01 16:07:06 - INFO - Converted componentorder to interger.
2025-04-01 16:07:06 - INFO - Converted transcriptcomponenttypeid to interger.
2025-04-01 16:07:06 - INFO - Converted transcriptpersonid to interger.
2025-04-01 16:07:08 - INFO - Converted transcriptpresentationtypeid to string.
2025-04-01 16:07:08 - INFO - Converted speakertypeid to interger.
2025-04-01 16:07:09 - INFO - Converted transcriptpresentationtypeid to string.
2025-04-01 16:07:42 - INFO - Successfully added wrds_transcript_person to SQL database
2025-04-01 16:07:42 - INFO - None
2025-04-01 16:11:29 - INFO - Converted transcriptid to interger.
2025-04-01 16:11:29 - INFO - Converted transcriptcomponentid to interger.
2025-04-01 16:11:29 - INFO - Converted componentorder to interger.
2025-04-01 16:11:29 - INFO - Converted transcriptcomponenttypeid to interger.
2025-04-01 16:11:29 - INFO - Converted transcriptpersonid to interger.
2025-04-01 16:11:31 - INFO - Converted transcriptpresentationtypeid to string.
2025-04-01 16:11:31 - INFO - Converted speakertypeid to interger.
2025-04-01 16:11:32 - INFO - Converted transcriptpresentationtypeid to string.
2025-04-01 16:12:04 - INFO - Successfully added wrds_transcript_person to SQL database
2025-04-01 16:12:04 - INFO - None
2025-04-01 16:12:04 - INFO - Converted transcriptid to interger.
2025-04-01 16:12:04 - INFO - Converted transcriptpresentationtypeid to string.
2025-04-01 16:12:04 - INFO - Converted transcriptpresentationtypeid to string.
2025-04-01 16:12:04 - INFO - Converted transcriptpresentationtypeid to string.
2025-04-01 16:12:04 - INFO - Converted transcriptpresentationtypeid to string.
2025-04-01 16:12:04 - INFO - Converted transcriptpresentationtypeid to string.
2025-04-01 16:12:04 - INFO - Converted transcriptpresentationtypeid to string.
2025-04-01 16:12:04 - INFO - Converted transcriptpresentationtypeid to string.
2025-04-01 16:12:04 - INFO - Successfully added wrds_transcript_person to SQL database
2025-04-01 16:12:04 - INFO - None
2025-04-01 16:14:09 - INFO - Successfully added ciqtranscriptcomponent to SQL database
2025-04-01 16:14:09 - INFO - None
2025-04-01 16:16:04 - INFO - Successfully added ciqtranscriptcomponent to SQL database
2025-04-01 16:16:04 - INFO - None
2025-04-01 16:17:36 - INFO - Successfully added ciqtranscriptcomponent to SQL database
2025-04-01 16:17:36 - INFO - None
2025-04-01 16:19:39 - INFO - Successfully added ciqtranscriptcomponent to SQL database
2025-04-01 16:19:39 - INFO - None
2025-04-01 16:21:48 - INFO - Successfully added ciqtranscriptcomponent to SQL database
2025-04-01 16:21:48 - INFO - None
2025-04-01 16:23:48 - INFO - Successfully added ciqtranscriptcomponent to SQL database
2025-04-01 16:23:48 - INFO - None
2025-04-01 16:25:44 - INFO - Successfully added ciqtranscriptcomponent to SQL database
2025-04-01 16:25:44 - INFO - None
2025-04-01 16:27:50 - INFO - Successfully added ciqtranscriptcomponent to SQL database
2025-04-01 16:27:50 - INFO - None
2025-04-01 16:29:44 - INFO - Successfully added ciqtranscriptcomponent to SQL database
2025-04-01 16:29:44 - INFO - None
2025-04-01 16:32:08 - INFO - Successfully added ciqtranscriptcomponent to SQL database
2025-04-01 16:32:08 - INFO - None
2025-04-01 16:34:46 - INFO - Successfully added ciqtranscriptcomponent to SQL database
2025-04-01 16:34:46 - INFO - None
2025-04-01 16:36:50 - INFO - Successfully added ciqtranscriptcomponent to SQL database
2025-04-01 16:36:50 - INFO - None
2025-04-01 16:38:32 - INFO - Successfully added ciqtranscriptcomponent to SQL database
2025-04-01 16:38:32 - INFO - None
2025-04-01 16:40:18 - INFO - Successfully added ciqtranscriptcomponent to SQL database
2025-04-01 16:40:18 - INFO - None
2025-04-01 16:41:52 - INFO - Successfully added ciqtranscriptcomponent to SQL database
2025-04-01 16:41:52 - INFO - None
2025-04-01 16:43:39 - INFO - Successfully added ciqtranscriptcomponent to SQL database
2025-04-01 16:43:39 - INFO - None
2025-04-01 16:45:23 - INFO - Successfully added ciqtranscriptcomponent to SQL database
2025-04-01 16:45:23 - INFO - None
2025-04-01 16:47:04 - INFO - Successfully added ciqtranscriptcomponent to SQL database
2025-04-01 16:47:04 - INFO - None
2025-04-01 16:48:46 - INFO - Successfully added ciqtranscriptcomponent to SQL database
2025-04-01 16:48:46 - INFO - None
2025-04-01 16:50:33 - INFO - Successfully added ciqtranscriptcomponent to SQL database
2025-04-01 16:50:33 - INFO - None
2025-04-01 16:51:55 - INFO - Successfully added ciqtranscriptcomponent to SQL database
2025-04-01 16:51:55 - INFO - None
2025-04-01 16:53:36 - INFO - Successfully added ciqtranscriptcomponent to SQL database
2025-04-01 16:53:36 - INFO - None
2025-04-01 16:55:09 - INFO - Successfully added ciqtranscriptcomponent to SQL database
2025-04-01 16:55:09 - INFO - None
2025-04-01 16:56:32 - INFO - Successfully added ciqtranscriptcomponent to SQL database
2025-04-01 16:56:32 - INFO - None
2025-04-01 16:58:23 - INFO - Successfully added ciqtranscriptcomponent to SQL database
2025-04-01 16:58:23 - INFO - None
2025-04-01 16:59:55 - INFO - Successfully added ciqtranscriptcomponent to SQL database
2025-04-01 16:59:55 - INFO - None
2025-04-01 17:01:29 - INFO - Successfully added ciqtranscriptcomponent to SQL database
2025-04-01 17:01:29 - INFO - None
2025-04-01 17:02:57 - INFO - Successfully added ciqtranscriptcomponent to SQL database
2025-04-01 17:02:57 - INFO - None
2025-04-01 17:04:29 - INFO - Successfully added ciqtranscriptcomponent to SQL database
2025-04-01 17:04:29 - INFO - None
2025-04-01 17:06:01 - INFO - Successfully added ciqtranscriptcomponent to SQL database
2025-04-01 17:06:01 - INFO - None
2025-04-01 17:06:01 - INFO - Script execution completed in 01:48:00.
2025-04-01 21:01:03 - INFO - Connecting to SQLite database at: ../output/wrds_ciq_2024.db
2025-04-01 21:01:03 - INFO - Summarizing table: wrds_transcript_detail
2025-04-01 21:01:03 - INFO - Table wrds_transcript_detail has 9 columns: ['companyid', 'keydevid', 'transcriptid', 'mostimportantdateutc', 'keydeveventtypeid', 'transcriptcollectiontypeid', 'transcriptpresentationtypeid', 'transcriptcreationdate_utc', 'transcriptcreationtime_utc']
2025-04-01 21:01:03 - INFO - Table wrds_transcript_detail has 1575627 rows
2025-04-01 21:01:03 - INFO - Summarizing table: wrds_transcript_person
2025-04-01 21:01:03 - INFO - Table wrds_transcript_person has 10 columns: ['transcriptid', 'transcriptcomponentid', 'componentorder', 'transcriptcomponenttypeid', 'transcriptpersonid', 'transcriptpersonname', 'proid', 'companyofperson', 'speakertypeid', 'word_count']
2025-04-01 21:01:05 - INFO - Table wrds_transcript_person has 81727103 rows
2025-04-01 21:01:05 - INFO - Summarizing table: ciqtranscriptcomponent
2025-04-01 21:01:05 - INFO - Table ciqtranscriptcomponent has 6 columns: ['transcriptcomponentid', 'transcriptid', 'componentorder', 'transcriptcomponenttypeid', 'transcriptpersonid', 'componenttext']
2025-04-01 21:01:31 - INFO - Table ciqtranscriptcomponent has 81899279 rows
2025-04-01 21:01:31 - INFO - SQLite connection closed.
2025-04-01 21:01:31 - INFO - SQLite summary completed in 00:00:27
2025-04-01 21:01:31 - INFO - Starting pickle file summary in folder: ../output/wrds_transcript_person
2025-04-01 21:09:49 - INFO - Loaded DataFrame from ../output\wrds_transcript_person_01.pkl with shape (10071223, 13), file size: 646.27 MB, memory usage: 5001.29 MB
2025-04-01 21:15:22 - INFO - Loaded DataFrame from ../output\wrds_transcript_person_02.pkl with shape (8907751, 13), file size: 610.96 MB, memory usage: 4442.02 MB
2025-04-01 21:20:51 - INFO - Loaded DataFrame from ../output\wrds_transcript_person_03.pkl with shape (8728803, 13), file size: 605.30 MB, memory usage: 4264.35 MB
2025-04-01 21:25:49 - INFO - Loaded DataFrame from ../output\wrds_transcript_person_04.pkl with shape (8462389, 13), file size: 596.45 MB, memory usage: 4136.95 MB
2025-04-01 21:29:51 - INFO - Loaded DataFrame from ../output\wrds_transcript_person_05.pkl with shape (7786576, 13), file size: 546.59 MB, memory usage: 3797.03 MB
2025-04-01 21:34:09 - INFO - Loaded DataFrame from ../output\wrds_transcript_person_06.pkl with shape (7966017, 13), file size: 559.53 MB, memory usage: 3878.54 MB
2025-04-01 21:39:15 - INFO - Loaded DataFrame from ../output\wrds_transcript_person_07.pkl with shape (7636382, 13), file size: 511.96 MB, memory usage: 3723.66 MB
2025-04-01 21:43:32 - INFO - Loaded DataFrame from ../output\wrds_transcript_person_08.pkl with shape (7388901, 13), file size: 477.44 MB, memory usage: 3625.72 MB
2025-04-01 21:48:03 - INFO - Loaded DataFrame from ../output\wrds_transcript_person_09.pkl with shape (7552993, 13), file size: 486.12 MB, memory usage: 3716.30 MB
2025-04-01 21:51:53 - INFO - Loaded DataFrame from ../output\wrds_transcript_person_10.pkl with shape (7223709, 13), file size: 470.38 MB, memory usage: 3554.59 MB
2025-04-01 21:51:54 - INFO - Loaded DataFrame from ../output\wrds_transcript_person_x.pkl with shape (2359, 13), file size: 0.02 MB, memory usage: 0.75 MB
2025-04-01 21:51:54 - INFO - File wrds_transcript_person_01.pkl: 10071223 rows, 13 columns, size: 646.27 MB, memory: 5001.29 MB
2025-04-01 21:51:54 - INFO - File wrds_transcript_person_02.pkl: 8907751 rows, 13 columns, size: 610.96 MB, memory: 4442.02 MB
2025-04-01 21:51:54 - INFO - File wrds_transcript_person_03.pkl: 8728803 rows, 13 columns, size: 605.3 MB, memory: 4264.35 MB
2025-04-01 21:51:54 - INFO - File wrds_transcript_person_04.pkl: 8462389 rows, 13 columns, size: 596.45 MB, memory: 4136.95 MB
2025-04-01 21:51:54 - INFO - File wrds_transcript_person_05.pkl: 7786576 rows, 13 columns, size: 546.59 MB, memory: 3797.03 MB
2025-04-01 21:51:54 - INFO - File wrds_transcript_person_06.pkl: 7966017 rows, 13 columns, size: 559.53 MB, memory: 3878.54 MB
2025-04-01 21:51:54 - INFO - File wrds_transcript_person_07.pkl: 7636382 rows, 13 columns, size: 511.96 MB, memory: 3723.66 MB
2025-04-01 21:51:54 - INFO - File wrds_transcript_person_08.pkl: 7388901 rows, 13 columns, size: 477.44 MB, memory: 3625.72 MB
2025-04-01 21:51:54 - INFO - File wrds_transcript_person_09.pkl: 7552993 rows, 13 columns, size: 486.12 MB, memory: 3716.3 MB
2025-04-01 21:51:54 - INFO - File wrds_transcript_person_10.pkl: 7223709 rows, 13 columns, size: 470.38 MB, memory: 3554.59 MB
2025-04-01 21:51:54 - INFO - File wrds_transcript_person_x.pkl: 2359 rows, 13 columns, size: 0.02 MB, memory: 0.75 MB
2025-04-01 21:51:54 - INFO - Completed summarizing 11 pickle files from ../output/wrds_transcript_person
2025-04-01 21:51:54 - INFO - Starting pickle file summary in folder: ../output/ciqtranscriptcomponent
2025-04-01 21:53:39 - INFO - Loaded DataFrame from ../output\ciqtranscriptcomponent_01.pkl with shape (3860671, 6), file size: 694.57 MB, memory usage: 3043.28 MB
2025-04-01 21:55:04 - INFO - Loaded DataFrame from ../output\ciqtranscriptcomponent_02.pkl with shape (3377437, 6), file size: 707.76 MB, memory usage: 2656.91 MB
2025-04-01 21:56:24 - INFO - Loaded DataFrame from ../output\ciqtranscriptcomponent_03.pkl with shape (2964202, 6), file size: 673.99 MB, memory usage: 2545.84 MB
2025-04-01 21:58:50 - INFO - Loaded DataFrame from ../output\ciqtranscriptcomponent_04.pkl with shape (2935565, 6), file size: 676.67 MB, memory usage: 2630.33 MB
2025-04-01 22:03:41 - INFO - Loaded DataFrame from ../output\ciqtranscriptcomponent_05.pkl with shape (3082338, 6), file size: 715.56 MB, memory usage: 2696.31 MB
2025-04-01 22:06:00 - INFO - Loaded DataFrame from ../output\ciqtranscriptcomponent_06.pkl with shape (2927947, 6), file size: 689.60 MB, memory usage: 2589.98 MB
2025-04-01 22:08:11 - INFO - Loaded DataFrame from ../output\ciqtranscriptcomponent_07.pkl with shape (2895989, 6), file size: 708.88 MB, memory usage: 2490.47 MB
2025-04-01 22:10:21 - INFO - Loaded DataFrame from ../output\ciqtranscriptcomponent_08.pkl with shape (2991468, 6), file size: 704.16 MB, memory usage: 2421.50 MB
2025-04-01 22:11:52 - INFO - Loaded DataFrame from ../output\ciqtranscriptcomponent_09.pkl with shape (2846694, 6), file size: 681.63 MB, memory usage: 2306.55 MB
2025-04-01 22:13:22 - INFO - Loaded DataFrame from ../output\ciqtranscriptcomponent_10.pkl with shape (2907243, 6), file size: 715.41 MB, memory usage: 2419.47 MB
2025-04-01 22:14:46 - INFO - Loaded DataFrame from ../output\ciqtranscriptcomponent_11.pkl with shape (2781713, 6), file size: 679.74 MB, memory usage: 2308.55 MB
2025-04-01 22:16:16 - INFO - Loaded DataFrame from ../output\ciqtranscriptcomponent_12.pkl with shape (2773434, 6), file size: 693.22 MB, memory usage: 2348.36 MB
2025-04-01 22:17:52 - INFO - Loaded DataFrame from ../output\ciqtranscriptcomponent_13.pkl with shape (2599783, 6), file size: 650.96 MB, memory usage: 2205.31 MB
2025-04-01 22:19:16 - INFO - Loaded DataFrame from ../output\ciqtranscriptcomponent_14.pkl with shape (2666138, 6), file size: 676.01 MB, memory usage: 2279.26 MB
2025-04-01 22:20:32 - INFO - Loaded DataFrame from ../output\ciqtranscriptcomponent_15.pkl with shape (2520655, 6), file size: 636.43 MB, memory usage: 2146.63 MB
2025-04-01 22:22:26 - INFO - Loaded DataFrame from ../output\ciqtranscriptcomponent_16.pkl with shape (2655948, 6), file size: 643.69 MB, memory usage: 2177.02 MB
2025-04-01 22:23:45 - INFO - Loaded DataFrame from ../output\ciqtranscriptcomponent_17.pkl with shape (2674398, 6), file size: 696.33 MB, memory usage: 2335.39 MB
2025-04-01 22:25:02 - INFO - Loaded DataFrame from ../output\ciqtranscriptcomponent_18.pkl with shape (2635671, 6), file size: 664.43 MB, memory usage: 2243.40 MB
2025-04-01 22:26:19 - INFO - Loaded DataFrame from ../output\ciqtranscriptcomponent_19.pkl with shape (2635867, 6), file size: 652.08 MB, memory usage: 2206.72 MB
2025-04-01 22:27:40 - INFO - Loaded DataFrame from ../output\ciqtranscriptcomponent_20.pkl with shape (2704208, 6), file size: 677.98 MB, memory usage: 2288.13 MB
2025-04-01 22:28:40 - INFO - Loaded DataFrame from ../output\ciqtranscriptcomponent_21.pkl with shape (2296307, 6), file size: 611.54 MB, memory usage: 2070.16 MB
2025-04-01 22:30:02 - INFO - Loaded DataFrame from ../output\ciqtranscriptcomponent_22.pkl with shape (2614586, 6), file size: 661.61 MB, memory usage: 2248.30 MB
2025-04-01 22:31:14 - INFO - Loaded DataFrame from ../output\ciqtranscriptcomponent_23.pkl with shape (2461070, 6), file size: 670.26 MB, memory usage: 2266.30 MB
2025-04-01 22:32:16 - INFO - Loaded DataFrame from ../output\ciqtranscriptcomponent_24.pkl with shape (2313245, 6), file size: 607.42 MB, memory usage: 2060.15 MB
2025-04-01 22:33:37 - INFO - Loaded DataFrame from ../output\ciqtranscriptcomponent_25.pkl with shape (2641809, 6), file size: 696.31 MB, memory usage: 2383.52 MB
2025-04-01 22:34:46 - INFO - Loaded DataFrame from ../output\ciqtranscriptcomponent_26.pkl with shape (2429020, 6), file size: 648.51 MB, memory usage: 2204.99 MB
2025-04-01 22:35:59 - INFO - Loaded DataFrame from ../output\ciqtranscriptcomponent_27.pkl with shape (2482164, 6), file size: 629.62 MB, memory usage: 2178.95 MB
2025-04-01 22:37:03 - INFO - Loaded DataFrame from ../output\ciqtranscriptcomponent_28.pkl with shape (2346041, 6), file size: 617.45 MB, memory usage: 2119.30 MB
2025-04-01 22:38:13 - INFO - Loaded DataFrame from ../output\ciqtranscriptcomponent_29.pkl with shape (2445223, 6), file size: 627.71 MB, memory usage: 2149.01 MB
2025-04-01 22:39:22 - INFO - Loaded DataFrame from ../output\ciqtranscriptcomponent_30.pkl with shape (2432445, 6), file size: 618.80 MB, memory usage: 2110.32 MB
2025-04-01 22:39:22 - INFO - File ciqtranscriptcomponent_01.pkl: 3860671 rows, 6 columns, size: 694.57 MB, memory: 3043.28 MB
2025-04-01 22:39:22 - INFO - File ciqtranscriptcomponent_02.pkl: 3377437 rows, 6 columns, size: 707.76 MB, memory: 2656.91 MB
2025-04-01 22:39:22 - INFO - File ciqtranscriptcomponent_03.pkl: 2964202 rows, 6 columns, size: 673.99 MB, memory: 2545.84 MB
2025-04-01 22:39:22 - INFO - File ciqtranscriptcomponent_04.pkl: 2935565 rows, 6 columns, size: 676.67 MB, memory: 2630.33 MB
2025-04-01 22:39:22 - INFO - File ciqtranscriptcomponent_05.pkl: 3082338 rows, 6 columns, size: 715.56 MB, memory: 2696.31 MB
2025-04-01 22:39:22 - INFO - File ciqtranscriptcomponent_06.pkl: 2927947 rows, 6 columns, size: 689.6 MB, memory: 2589.98 MB
2025-04-01 22:39:22 - INFO - File ciqtranscriptcomponent_07.pkl: 2895989 rows, 6 columns, size: 708.88 MB, memory: 2490.47 MB
2025-04-01 22:39:22 - INFO - File ciqtranscriptcomponent_08.pkl: 2991468 rows, 6 columns, size: 704.16 MB, memory: 2421.5 MB
2025-04-01 22:39:22 - INFO - File ciqtranscriptcomponent_09.pkl: 2846694 rows, 6 columns, size: 681.63 MB, memory: 2306.55 MB
2025-04-01 22:39:22 - INFO - File ciqtranscriptcomponent_10.pkl: 2907243 rows, 6 columns, size: 715.41 MB, memory: 2419.47 MB
2025-04-01 22:39:22 - INFO - File ciqtranscriptcomponent_11.pkl: 2781713 rows, 6 columns, size: 679.74 MB, memory: 2308.55 MB
2025-04-01 22:39:22 - INFO - File ciqtranscriptcomponent_12.pkl: 2773434 rows, 6 columns, size: 693.22 MB, memory: 2348.36 MB
2025-04-01 22:39:22 - INFO - File ciqtranscriptcomponent_13.pkl: 2599783 rows, 6 columns, size: 650.96 MB, memory: 2205.31 MB
2025-04-01 22:39:22 - INFO - File ciqtranscriptcomponent_14.pkl: 2666138 rows, 6 columns, size: 676.01 MB, memory: 2279.26 MB
2025-04-01 22:39:22 - INFO - File ciqtranscriptcomponent_15.pkl: 2520655 rows, 6 columns, size: 636.43 MB, memory: 2146.63 MB
2025-04-01 22:39:22 - INFO - File ciqtranscriptcomponent_16.pkl: 2655948 rows, 6 columns, size: 643.69 MB, memory: 2177.02 MB
2025-04-01 22:39:22 - INFO - File ciqtranscriptcomponent_17.pkl: 2674398 rows, 6 columns, size: 696.33 MB, memory: 2335.39 MB
2025-04-01 22:39:22 - INFO - File ciqtranscriptcomponent_18.pkl: 2635671 rows, 6 columns, size: 664.43 MB, memory: 2243.4 MB
2025-04-01 22:39:22 - INFO - File ciqtranscriptcomponent_19.pkl: 2635867 rows, 6 columns, size: 652.08 MB, memory: 2206.72 MB
2025-04-01 22:39:22 - INFO - File ciqtranscriptcomponent_20.pkl: 2704208 rows, 6 columns, size: 677.98 MB, memory: 2288.13 MB
2025-04-01 22:39:22 - INFO - File ciqtranscriptcomponent_21.pkl: 2296307 rows, 6 columns, size: 611.54 MB, memory: 2070.16 MB
2025-04-01 22:39:22 - INFO - File ciqtranscriptcomponent_22.pkl: 2614586 rows, 6 columns, size: 661.61 MB, memory: 2248.3 MB
2025-04-01 22:39:22 - INFO - File ciqtranscriptcomponent_23.pkl: 2461070 rows, 6 columns, size: 670.26 MB, memory: 2266.3 MB
2025-04-01 22:39:22 - INFO - File ciqtranscriptcomponent_24.pkl: 2313245 rows, 6 columns, size: 607.42 MB, memory: 2060.15 MB
2025-04-01 22:39:22 - INFO - File ciqtranscriptcomponent_25.pkl: 2641809 rows, 6 columns, size: 696.31 MB, memory: 2383.52 MB
2025-04-01 22:39:22 - INFO - File ciqtranscriptcomponent_26.pkl: 2429020 rows, 6 columns, size: 648.51 MB, memory: 2204.99 MB
2025-04-01 22:39:22 - INFO - File ciqtranscriptcomponent_27.pkl: 2482164 rows, 6 columns, size: 629.62 MB, memory: 2178.95 MB
2025-04-01 22:39:22 - INFO - File ciqtranscriptcomponent_28.pkl: 2346041 rows, 6 columns, size: 617.45 MB, memory: 2119.3 MB
2025-04-01 22:39:22 - INFO - File ciqtranscriptcomponent_29.pkl: 2445223 rows, 6 columns, size: 627.71 MB, memory: 2149.01 MB
2025-04-01 22:39:22 - INFO - File ciqtranscriptcomponent_30.pkl: 2432445 rows, 6 columns, size: 618.8 MB, memory: 2110.32 MB
2025-04-01 22:39:22 - INFO - Completed summarizing 30 pickle files from ../output/ciqtranscriptcomponent
2025-04-01 22:39:23 - INFO - Pickle summary completed in 01:37:52
2025-04-01 22:39:23 - INFO - Saved pickle summary to wrds_pickle_summary.csv
