Remix clone Hacker News

new | show | ask | jobs Github

▲

gdzie-jest-sol 3 hours ago

* How creating dataset? I download it but it is commpresed in binary format.

* How training. In cloud or in my own dev

* How creating a gguf

▲ gdzie-jest-sol 3 hours ago | parent | next [-]

``` uv run python -m guppylm chat

Traceback (most recent call last):

  File "<frozen runpy>", line 198, in _run_module_as_main
  File "<frozen runpy>", line 88, in _run_code
  File "/home/user/gupik/guppylm/guppylm/__main__.py", line 48, in <module>
    main()
  File "/home/user/gupik/guppylm/guppylm/__main__.py", line 29, in main
    engine = GuppyInference("checkpoints/best_model.pt", "data/tokenizer.json")
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/user/gupik/guppylm/guppylm/inference.py", line 17, in __init__
    self.tokenizer = Tokenizer.from_file(tokenizer_path)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

Exception: No such file or directory (os error 2) ```

	▲	gdzie-jest-sol 2 hours ago \| parent [-]
		meybe add training again (read best od fine) and train again ``` # after config device checkpoint_path = "checkpoints/best_model.pt" ckpt = torch.load(checkpoint_path, map_location=device, weights_only=False) model = GuppyLM(mc).to(device) if "model_state_dict" in ckpt: model.load_state_dict(ckpt["model_state_dict"]) else: model.load_state_dict(ckpt) start_step = ckpt.get("step", 0) print(f"Encore {start_step}") ```

▲ freetonik 3 hours ago | parent | prev [-]

You sound like Guppy. Nice touch.