Project structure of: OrigamiDream/gato

• gato Gato: ML, transformers, NLP embeddings, dev implementation
  • gato Gato: ML models, transformers, NLP embeddings
    • __init__.py Gato init: Imports, enables tensor chaining.
    • config.py ML model initialization with tokenization and transformer layers.
    • models Gato models: Transformers, NLP embeddings.
      • __init__.py Gato: Keras model processes diverse inputs with encodings.
      • embedding.py PatchPos Embedding, Residual Layers, LocalPositionEncoding, DiscreteEmbedding for NLP
      • tokenizers.py Mu-law tokenizer for continuous values
      • transformer.py Transformer model with attention, dropout, layer normalization
  • README.md Unofficial Gato Transformer implementation, in development, requires datasets.
  • setup.py Setup script for gato-tf package using setuptools