Skip to content

BUG - GLOWS L1a: histogram duplicates for some CDFs #2905

@mstrumik

Description

@mstrumik

Description of the issue

Some L1a CDFs generated from flight data contain histogram duplicates:
imap_glows_l1a_hist_20251113-repoint00047_v001.cdf -> 116 duplicates found
imap_glows_l1a_hist_20251115-repoint00049_v001.cdf -> 1 duplicates found
imap_glows_l1a_hist_20251119-repoint00053_v001.cdf -> 1 duplicates found
imap_glows_l1a_hist_20251208-repoint00072_v001.cdf -> 123 duplicates found
imap_glows_l1a_hist_20251210-repoint00074_v001.cdf -> 147 duplicates found
imap_glows_l1a_hist_20251211-repoint00075_v001.cdf -> 38 duplicates found
imap_glows_l1a_hist_20260120-repoint00132_v001.cdf -> 46 duplicates found
imap_glows_l1a_hist_20260127-repoint00139_v001.cdf -> 57 duplicates found
imap_glows_l1a_hist_20260208-repoint00151_v001.cdf -> 1 duplicates found
imap_glows_l1a_hist_20260310-repoint00181_v001.cdf -> 1 duplicates found

Steps to reproduce the issue

See the code snippet attached

Expected vs Actual behavior

No duplicates expected, but found for some L1a CDFs.

Code Snippet (If applicable)

import glob
import numpy as np
from cdflib.xarray import cdf_to_xarray

if __name__ == '__main__':
  cdf_list = sorted(glob.glob('data/imap/glows/l1a/20??/??/imap_glows_l1a_hist_20*.cdf'))
  for cdf in cdf_list:
    xr = cdf_to_xarray(cdf)
    t_cdf = xr.epoch.values.tolist()
    unique_cdf, counts_cdf = np.unique(t_cdf, return_counts=True)
    dups_cdf = unique_cdf[counts_cdf > 1]
    if len(dups_cdf) > 0:
      print(cdf.split('/')[-1], ' -> ', len(dups_cdf), 'duplicates found')

Additional notes, affected areas, and suggested fixes

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    Ins: GLOWSRelated to the GLOWS instrumentbugSomething isn't working

    Type

    Projects

    Status

    Todo

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions