【问题标题】:Python create tree from a JSON filePython 从 JSON 文件创建树
【发布时间】:2023-04-04 12:57:02
【问题描述】:

假设我们有以下 JSON 文件。出于示例的目的,它由字符串模拟。字符串是输入,Tree 对象应该是输出。我将使用树的图形符号来呈现输出。

我找到了以下类来处理 Python 中的树概念:

class TreeNode(object):
    def __init__(self, data):
        self.data = data
        self.children = []

    def add_child(self, obj):
        self.children.append(obj)

    def __str__(self, level=0):
        ret = "\t"*level+repr(self.data)+"\n"
        for child in self.children:
            ret += child.__str__(level+1)
        return ret

    def __repr__(self):
        return '<tree node representation>'

class Tree:
    def __init__(self):
        self.root = TreeNode('ROOT')

    def __str__(self):
        return self.root.__str__()

输入文件可以有不同的复杂度:

简单案例

输入:

json_file = '{"item1": "end1", "item2": "end2"}'

输出:

"ROOT"
    item1
        end1
    item2
        end2

嵌入式案例

输入:

json_file = {"item1": "end1", "item2": {"item3": "end3"}}

输出:

"ROOT"
    item1
        end1
    item2
        item3
            end3

数组案例

输入:

json_file = { "name": "John", "items": [ { "item_name": "lettuce", "price": 2.65, "units": "no" }, { "item_name": "ketchup", "price": 1.51, "units": "litres" } ] }

输出:

"ROOT"
    name
        John
    items
        1
            item_name
                lettuce
            price
                2.65
            units
                no
        2   
            item_name
                ketchup
            price
                1.51
            units
                litres

请注意,数组中的每一项都用一个整数(从 1 开始)描述。

到目前为止,我已经设法提出了以下功能,可以解决简单案例的问题。就嵌入式案例而言,我知道我必须使用递归,但到目前为止我得到了UnboundLocalError: local variable 'tree' referenced before assignment

def create_tree_from_JSON(json, parent=None):
    if not parent:
        tree = Tree()
        node_0 = TreeNode("ROOT")
        tree.root = node_0
        parent = node_0
    else:
        parent = parent

    for key in json:
        if isinstance(json[key], dict):
            head = TreeNode(key)
            create_tree_from_JSON(json[key], head)
        else:
            node = TreeNode(key)
            node.add_child(TreeNode(json[key]))
            parent.add_child(node)

    return tree

问题的背景

您可能想知道为什么我需要将 JSON 对象更改为树。您可能知道 PostgreSQL 提供了一种处理数据库中 JSON 字段的方法。给定一个 JSON 对象,我可以使用 -&gt;-&gt;&gt; 表示法获取任何字段的值。 Herehere 更多关于该主题的信息。我将根据字段的名称和值创建新表。不幸的是,JSON 对象的变化如此之大,以至于我无法手动编写 .sql 代码 - 我必须找到一种方法来自动完成。

假设我想根据嵌入的情况创建一个表。我需要得到以下.sql 代码:

select 
    content_json ->> 'item1' as end1,
    content_json -> 'item_2' ->> 'item_3' as end3
from table_with_json

content_json替换"ROOT",你可以看到SQL代码中的每一行只是从“ROOT”到叶子的深度优先遍历(从最后一个节点移动到叶子总是用-&gt;&gt;注释)。

编辑:为了使问题更清楚,我正在为数组案例添加目标 .sql 查询。我希望有与数组中的元素一样多的查询:

select
    content_json ->> 'name' as name,
    content_json -> 'items' -> 1 -> 'item_name' as item_name,
    content_json -> 'items' -> 1 -> 'price' as price,
    content_json -> 'items' -> 1 -> 'units' as units
from table_with_json

select
    content_json ->> 'name' as name,
    content_json -> 'items' -> 2 ->> 'item_name' as item_name,
    content_json -> 'items' -> 2 ->> 'price' as price,
    content_json -> 'items' -> 2 ->> 'units' as units
from table_with_json

到目前为止的解决方案 (07.05.2019)

我目前正在测试当前的解决方案:

from collections import OrderedDict

def treeify(data) -> dict:
    if isinstance(data, dict):  # already have keys, just recurse
        return OrderedDict((key, treeify(children)) for key, children in data.items())
    elif isinstance(data, list):  # make keys from indices
        return OrderedDict((idx, treeify(children)) for idx, children in enumerate(data, start=1))
    else:  # leave node, no recursion
        return data

def format_query(tree, stack=('content_json',)) -> str:
    if isinstance(tree, dict):  # build stack of keys
        for key, child in tree.items():
            yield from format_query(child, stack + (key,))
    else:  # print complete stack, discarding leaf data in tree
        *keys, field = stack
        path = ' -> '.join(
            str(key) if isinstance(key, int) else "'%s'" % key
            for key in keys
        )
        yield path + " ->> '%s' as %s" % (field, field)

def create_select_query(lines_list):
    query = "select\n"
    for line_number in range(len(lines_list)):
        if "_class" in lines_list[line_number]:
            # ignore '_class' fields
            continue
        query += "\t" + lines_list[line_number]
        if line_number == len(lines_list)-1:
            query += "\n"
        else:
            query += ",\n"
    query += "from table_with_json"
    return query

我目前正在处理这样的 JSON:

stack_nested_example = {"_class":"value_to_be_ignored","first_key":{"second_key":{"user_id":"123456","company_id":"9876","question":{"subject":"some_subject","case_type":"urgent","from_date":{"year":2011,"month":11,"day":11},"to_date":{"year":2012,"month":12,"day":12}},"third_key":[{"role":"driver","weather":"great"},{"role":"father","weather":"rainy"}]}}}

在输出中,我得到唯一不变的元素是用数组逻辑处理的行的顺序。其他行的顺序不同。我想得到的输出是考虑到键顺序的输出:

select
        'content_json' -> 'first_key' -> 'second_key' ->> 'user_id' as user_id,
        'content_json' -> 'first_key' -> 'second_key' ->> 'company_id' as company_id,
        'content_json' -> 'first_key' -> 'second_key' -> 'question' ->> 'subject' as subject,
        'content_json' -> 'first_key' -> 'second_key' -> 'question' ->> 'case_type' as case_type,
        'content_json' -> 'first_key' -> 'second_key' -> 'question' -> 'from_date' ->> 'year' as year,
        'content_json' -> 'first_key' -> 'second_key' -> 'question' -> 'from_date' ->> 'month' as month,
        'content_json' -> 'first_key' -> 'second_key' -> 'question' -> 'from_date' ->> 'day' as day,
        'content_json' -> 'first_key' -> 'second_key' -> 'question' -> 'to_date' ->> 'year' as year,
        'content_json' -> 'first_key' -> 'second_key' -> 'question' -> 'to_date' ->> 'month' as month,
        'content_json' -> 'first_key' -> 'second_key' -> 'question' -> 'to_date' ->> 'day' as day,
        'content_json' -> 'first_key' -> 'second_key' -> 'third_key' -> 1 ->> 'role' as role,
        'content_json' -> 'first_key' -> 'second_key' -> 'third_key' -> 1 ->> 'weather' as weather,
        'content_json' -> 'first_key' -> 'second_key' -> 'third_key' -> 2 ->> 'role' as role,
        'content_json' -> 'first_key' -> 'second_key' -> 'third_key' -> 2 ->> 'weather' as weather
from table_with_json

【问题讨论】:

标签:
python
json
recursion
tree