This might help you.

def func1(data):
    for key,value in data.items():
        print (str(key)+'->'+str(value))
        if type(value) == type(dict()):
            func1(value)
        elif type(value) == type(list()):
            for val in value:
                if type(val) == type(str()):
                    pass
                elif type(val) == type(list()):
                    pass
                else:
                    func1(val)
func1(data)

All you have to do is to pass the JSON Object as Dictionary to the Function.

There is also this python library that might help you with this.You can find this here -> JsonJ

PEACE BRO!!!

What are my options here?

Use a recursive generator to "walk" the JSON, yielding each element of the final list you want.

https://stackoverflow.com/questions/12507206/how-to-completely-traverse-a-complex-dictionary-of-unknown-depth

Loop through countries['Europe'].items():

countries = {"Europe":
             {"Germany": [{"hostname": "host1"}],
              "Poland": [{"hostname": "host2"}],
              "Denmark": [{"hostname": "host3"}]}
             }    


for k, v in countries["Europe"].items():
    print(k, v[0]['hostname'])

Germany host1
Poland host2
Denmark host3
>>> 

You can use isinstance to check if something is a dict or a list. Something like this may work, but I haven't checked it.

output = {'name': 'StackOverflow',
      'competitors': [{'competitor': 'bing',
                       'link': 'bing.com'},
                      {'competitor': 'google',
                       'link': 'google.com'}],
      'acquisition': {'acquired_day': 16,
                      'acquired_month': 12,
                      'acquired_year': 2013,
                      'acquiring_company': {'name': 'Viggle',
                                            'permalink': 'viggle'}}}


def traverse(obj):
    if isinstance(obj, dict):
        for key, value in obj.iteritems():
            print('dict_key', key)
            traverse(value)
    elif isinstance(obj, list):
        for value in obj:
            traverse(value)
    else:
        print('value', obj)


traverse(output)

json_res['nodes'] is a dictionary. Iterating over a dictionary just gives you the keys, so the first value of node could be, for example, 'Server1'. If you want both the keys and values you can iterate using .items():

for key, node in json_res['nodes'].items():

If you only want the values of the nodes, you can use .values():

for node in json_res['nodes'].values():

Replace results["guid"] in your for loop to var["guid"]:

for var in results:
    item['guid'] = var["guid"]
    # do whatever you want with item['guid'] here

when you can access guid like results[0]["guid"] it means that you have list of dictionaries that every dictionary contains key named guid. in your for loop you use results (that is list) instead of var (that contain every dictionary in each iteration) that throws TypeError because list indices must be integers not strings (like "guid").

UPDATE: if you want to save each var["guid"] you can save them in a dictionary like this:

guid_holder = {"guid": []}
for var in results:
    guid_golder["guid].append(var["guid"])
for guid in guid_holder["guid"]:
    print(guid)

now guid_holder holds all elements.

results['playlists']['items'][0]['owner']['id']
                              ^___ this is a list index

Thus:

for item in results['playlists']['items']:
    print(item['owner']['id'])

It is often convenient to make intermediate variables in order to keep things more readable.

playlist_items = results['playlists']['items']
for item in playlist_items:
    owner = item['owner']
    print(owner['id'])

This is assuming I have correctly guessed the structure of your object based on only what you have shown. Hopefully, though, these examples give you some better ways of thinking about splitting up complex structures into meaningful chunks.

Here's the updated code with minimal changes, and it also fixes the issue while writing the JSONL file. The code in question would append a list of JSON to the file, which will make the file messier and hard to read through code.

import datetime
import json

ruletree = {
    "contract": "1234",
    "domainName": "www.domainA.com",
    "rules": {
        "name": "default",
        "children": [
            {
                "rule": "Rule1",
                "children": [],
                "behaviors": [
                    {
                        "name": "origin",
                        "options": {
                            "originType": "CUSTOMER",
                            "host": "gateway1.com",
                        },
                    }
                ],
            },
            {
                "rule": "Rule2",
                "children": [],
                "behaviors": [
                    {
                        "name": "origin",
                        "options": {
                            "originType": "CUSTOMER",
                            "host": "gateway2.com",
                        },
                    }
                ],
            },
        ],
    },
}

data = {
    'date_time': datetime.datetime.now(datetime.timezone.utc).strftime("%Y-%m-%d %H:%M:%S"),
    'domainName': ruletree['domainName'],
}

#code to get domainName, name & host
for rule in ruletree['rules']['children']:
    for behavior in rule['behaviors']:
        with open('domains.json', 'a+') as outfile: # writing to the file
            json.dump({
                **data,
                'rule': rule['rule'],
                'host': behavior['options']['host']
            }, outfile)
            outfile.write('\n')

File output:

{"date_time": "2023-07-11 11:28:21", "domainName": "www.domainA.com", "rule": "Rule1", "host": "gateway1.com"}
{"date_time": "2023-07-11 11:28:21", "domainName": "www.domainA.com", "rule": "Rule2", "host": "gateway2.com"}

Try:

def get_kv(o):
    if isinstance(o, dict):
        if "path" in o and "url" in o:
            yield o["path"], o["url"]
        for v in o.values():
            yield from get_kv(v)
    elif isinstance(o, list):
        for v in o:
            yield from get_kv(v)


print(dict(get_kv(data)))

Prints:

{
    "/1": "1_URL",
    "/12": "12_URL",
    "/123": "123_URL",
    "/13": "13_URL",
    "/131": "131_URL",
    "/1311": "1311_URL",
    "/13111": "13111_URL",
}