Skip to content

submitted log parser throws an exception #2

@perillaroc

Description

@perillaroc

Log records may have some errors when ecflow server crash.

For example, two records are in the same line in the following logs.

MSG:[00:23:58 15.5.2020] chd:complete /gmf_grapes_gfs_post/12/upload/ftp_togrib2/upload_togrib2_global/upload_togrib2_039
LOG:[00:23:58 15.5.2020]  complete: /gmf_grapes_gfs_post/12/upload/ftp_togrib2/upload_togrib2_global/upload_togrib2_039
MSG:[00:23:58 15.5.2020] chd:complete /gmf_grapes_gfs_post/12/upload/ftp_togrib2/upload_togrib2_global/upload_togrib2_006
LOG:[00:23:58 15.5.2020]  complete: /gmf_grapes_gfs_post/12/upload/ftp_togrib2/upload_togrib2_global/upload_togrib2_006
LOG:[00:23:58 15.5.2020]  submitted: /gmf_grapes_gfs_post/12/upload/ftp_togrib2/upload_togrib2_global/upload_togrib2_054 job_size:9824MSG:[03:58:52 15.5.2020] Ecflow version(4.11.1) boost(1.53.0) compiler(gcc 4.8.5) protocol(TEXT_ARCHIVE) Compiled on Dec 25 2018 06:53:21
MSG:[03:58:52 15.5.2020] Started at 2020-May-15 03:58:52 universal time
MSG:[03:58:52 15.5.2020] Host(login_b01)  Port(31071) using TCP/IP v4
MSG:[03:58:52 15.5.2020] ECF_HOME /g1/u/nwp_pd/ecfworks/ecflow
MSG:[03:58:52 15.5.2020] Job scheduling interval: 60
MSG:[03:58:52 15.5.2020] Server initial state is HALTED
MSG:[03:58:52 15.5.2020] Loading check point file /g1/u/nwp_pd/ecfworks/ecflow/login_b01.31071.check port = 31071
MSG:[03:58:52 15.5.2020] Loading of *DEFS* check point file SUCCEDED. Loaded 0 suites

The parser for submitted will throw an exception:

ValueError: invalid literal for int() with base 10: '9824MSG:[03:58:52 15.5.2020] Ecflow version(4.11.1) boost(1.53.0) compiler(gcc 4.8.5) protocol(TEXT_ARCHIVE) Compiled on Dec 25 2018 06:53:21\n'

The exception should be checked or use another function to parse int from string.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions