Error with tool.poetry.packages

[jbsilva]

The union fails if a pyproject.toml contains tool.poetry.packages as described in https://python-poetry.org/docs/pyproject/:

[tool.poetry]
# ...
packages = [
    { include = "my_package" },
    { include = "extra_package/**/*.py" },
]

The error is as follows:

d[k] = process(v)
File "...py3.10/lib/python3.10/site-packages/toml_union/toml_union.py", line 224, in process
assert all('name' in item for item in v), v
AssertionError: [{'include': 'my_package'}]

Unfortunately I won't be able to debug any further as I decided for another approach for my project.

[PasaOpasen]

thank u for your response, I will do something with that

[box9527]

Hi, I also hit this issue today. I am using MacOS and python 3.11.

packages = [{include = "app"}]

and part of error message:

File "/opt/homebrew/Caskroom/miniconda/base/lib/python3.12/site-packages/toml_union/toml_union.py", line 239, in disable_lists_dict
return process(dct)
^^^^^^^^^^^^
File "/opt/homebrew/Caskroom/miniconda/base/lib/python3.12/site-packages/toml_union/toml_union.py", line 235, in process
d[k] = process(v)
^^^^^^^^^^
File "/opt/homebrew/Caskroom/miniconda/base/lib/python3.12/site-packages/toml_union/toml_union.py", line 235, in process
d[k] = process(v)
^^^^^^^^^^
File "/opt/homebrew/Caskroom/miniconda/base/lib/python3.12/site-packages/toml_union/toml_union.py", line 225, in process
assert all('name' in item for item in v), v
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError: [{'include': 'app'}]

[box9527]

I do an approach as following and it works:

I override "python3.11/site-packages/toml_union/toml_union.py" as following:

def process(ata: TOML_DICT) -> TOML_DICT:
        d = copy.deepcopy(data)

        for k, v in list(data.items()):
            if isinstance(v, list) and v and isinstance(v[0], dict):
                assert all(
                    any(key in item for key in ['name', 'include']) for item in v
                ), f"Expected list of dicts with 'name' or 'include' in key: {v}"

                if k == "packages" and "tool" in data and "poetry" in data["tool"]:
                    continue

                new_entries = {}
                for idx, item in enumerate(v):
                    display_name = item.get("name") or item.get("include") or f"item{idx}"
                    filtered = {_k: _v for _k, _v in item.items() if _k != "name" and _k != "include"}
                    new_entries[f"{k}{SEP}{display_name}"] = process(filtered)

                d.pop(k)
                d.update(new_entries)

            elif isinstance(v, dict):
                d[k] = process(v)

        return d

and modify my "union_pyproject_toml.py" as following:

from pathlib import Path
from toml_union import toml_union_process

# run union
toml_union_process(
    files=Path('input').glob('*.toml'),
    outfile='output.toml',
    report='report.json',
    unicode_escape=True,

    overrides={
        'tool.poetry.name': 'brain',
        'tool.poetry.version': '0.00.987',
        'tool.poetry.packages': "[{include = \"app\"}]"
    }
)


# ------------------
import re

def fix_poetry_packages(toml_text: str) -> str:
    toml_text = re.sub(
        r"packages\s*=\s*'(\[\{.*?\}\])'", 
        r"packages = \1",
        toml_text
    )

    # remove [tool.poetry.packages___app] section
    toml_text = re.sub(
        r"\[tool\.poetry\.packages___app\](?:\n(?:[^\[]*?))*?(?=(\n\[|\Z))", 
        "",
        toml_text
    )

    return toml_text


with open("output.toml", "r", encoding="utf-8") as f:
    content = f.read()

fixed = fix_poetry_packages(content)

with open("pyproject.toml", "w", encoding="utf-8") as f:
    f.write(fixed)

and then I do "poetry install".

I hope that might help. :)