Version Changes#

2.4.3 (released)#

  • Changes to ecr_upload to support programmatic building and pushing of Docker images

  • Remove DynamoDB docs (moved to libera_cdk)

2.4.2 (released)#

  • BREAKING: Remove the AnyFilename polymorphic class. Please use AbstractValidFilename.from_file_path()

2.4.1 (released)#

  • Updating requirements of methods to use keyword arguments rather than positional arguments

  • Adding ProcessingStepIdentifier and DataProductIdentifier to the filenaming classes

  • Updating ecr names to work with the completion checker testing in libera_cdk

2.4.0 (released)#

  • Add properties to filenaming classes to retrieve data_product_id and processing_step_id

  • Add ProcessingStepIdentifier and DataProductIdentifier standardization to be used by downstream repos

2.3.1 (released)#

  • Fix os.path.join bug in filenaming module that broke mocked S3 paths and also fix typehinting

2.3.0 (released)#

  • Create CLI tools for AWS ECR image upload and Step Function triggering

  • Update manifest filenames to use ULID instead of timestamp for unique identifiers

  • Change logutil configure_task_logging to optionally log JSON to console

  • Allow configure_task_logging to optionally propagate DEBUG messages from specific loggers

  • Update documentation for how the database is used in the Libera project in DynamoDB

  • Create tools for DynamoDB in AWS for .pds files (CONS and PDS)

  • Replace the use of PostgreSQL with DynamoDB for the Libera project

2.2.0 (released)#

  • Add AnyFilename polymorphic class

  • Change filename of all products to a LiberaDataProductFilename that inherits from AnyFilename

  • Update filenaming convention to be all capital letters

  • Improve API for manifest module

  • Add prefixing to Filename classes for predictable archive paths

  • Add prefixing for manifest files for predictable and navigable paths in s3 buckets

  • Update git to include lfs and move test data to lfs

  • Improve database manager including caching improvements

  • Improve smart_copy_file and bug fixes to smart_open testing

  • Refactoring and improving pds ingest for database entries and integration testing in CDK

  • Added handling of construction records and pds files appropriately when ingesting

    • This includes reading a construction record and removing the pds file entry for the construction record itself

  • Improved testing of pds ingest and pds file orm models to more accurately reflect use cases

  • Added output manifest creation from input manifest to match timestamps in filenames of input and output manifests

  • Refactored pds ingest to use AnyPath objects for handling file locations

  • Added error handling to pds ingest

2.1.1 (released)#

  • Update dependency specification to speed up dependency resolution wrt botocore/urllib3

  • Improve database initialization to work with libera_cdk changes

  • Fix bug in Dockerfile that incorrectly set the default entrypoint

  • Add preliminary instrument kernel

2.1.0 (released)#

  • Improve API to Manifest and Manifest.add_files

  • Add manifest filename enforcement to Manifest class

  • Update filenaming conventions for product filenames and SPICE kernels

  • Allow adding an s3 bucket/prefix as a basepath for filenames

2.0.1 (released)#

  • Remove the extras dependency spec because of the way SQLAlchemy imports models

2.0.0 (released)#

  • Add filenaming classes

  • Add manifest file class

  • Add construction record parser

  • Update DB schema to store construction records

  • Update kernel generation CLI to use manifest file pattern

  • Shift database and spice related libraries to extras (not installed by default)

  • Add smart_copy_file function that can copy files to and from S3 and filesystem locations transparently

  • Remove HDF-EOS5 filehandling code

  • Add quality flag classes

  • Change license to BSD3

1.0.0 (released)#

  • Stub out project structure

  • Add build and release processes to readme

  • Switch to Poetry for project dependency configuration and build management

  • Add geolocation module

  • Add tools in spiceutil module for caching SPICE kernels from NAIF

  • Add missing unit testing coverage

  • Add spice.md documentation on how the package uses and manages SPICE kernels

  • Add database tooling, dev database, and ORM setup

  • Add smart_open for opening local or S3 objects

  • Add logging utility functions for setting up application logging

On this page
Show Source