-
Notifications
You must be signed in to change notification settings - Fork 29
BUG - GLOWS L1a: histogram duplicates for some CDFs #2905
Description
Description of the issue
Some L1a CDFs generated from flight data contain histogram duplicates:
imap_glows_l1a_hist_20251113-repoint00047_v001.cdf -> 116 duplicates found
imap_glows_l1a_hist_20251115-repoint00049_v001.cdf -> 1 duplicates found
imap_glows_l1a_hist_20251119-repoint00053_v001.cdf -> 1 duplicates found
imap_glows_l1a_hist_20251208-repoint00072_v001.cdf -> 123 duplicates found
imap_glows_l1a_hist_20251210-repoint00074_v001.cdf -> 147 duplicates found
imap_glows_l1a_hist_20251211-repoint00075_v001.cdf -> 38 duplicates found
imap_glows_l1a_hist_20260120-repoint00132_v001.cdf -> 46 duplicates found
imap_glows_l1a_hist_20260127-repoint00139_v001.cdf -> 57 duplicates found
imap_glows_l1a_hist_20260208-repoint00151_v001.cdf -> 1 duplicates found
imap_glows_l1a_hist_20260310-repoint00181_v001.cdf -> 1 duplicates found
Steps to reproduce the issue
See the code snippet attached
Expected vs Actual behavior
No duplicates expected, but found for some L1a CDFs.
Code Snippet (If applicable)
import glob
import numpy as np
from cdflib.xarray import cdf_to_xarray
if __name__ == '__main__':
cdf_list = sorted(glob.glob('data/imap/glows/l1a/20??/??/imap_glows_l1a_hist_20*.cdf'))
for cdf in cdf_list:
xr = cdf_to_xarray(cdf)
t_cdf = xr.epoch.values.tolist()
unique_cdf, counts_cdf = np.unique(t_cdf, return_counts=True)
dups_cdf = unique_cdf[counts_cdf > 1]
if len(dups_cdf) > 0:
print(cdf.split('/')[-1], ' -> ', len(dups_cdf), 'duplicates found')Additional notes, affected areas, and suggested fixes
No response
Metadata
Metadata
Assignees
Labels
Type
Projects
Status