Filtering dictionaries and creating sub-dictionaries based on keys/values in Python?

dictionary, filter, list, python

Solution

Here is a not so pretty way of doing it. The result is a generator, but if you really want a list you can surround it with a call to `list()`. Mostly it doesn't matter.

The predicate is a function which decides for each key/value pair if a dictionary in the list is going to cut it. The default one accepts all. If no k/v-pair in the dictionary matches it is rejected.

def filter_data(data, predicate=lambda k, v: True):
    for d in data:
         for k, v in d.items():
               if predicate(k, v):
                    yield d


test_data = [{"key1":"value1", "key2":"value2"}, {"key1":"blabla"}, {"key1":"value1", "eh":"uh"}]
list(filter_data(test_data, lambda k, v: k == "key1" and v == "value1"))
# [{'key2': 'value2', 'key1': 'value1'}, {'key1': 'value1', 'eh': 'uh'}]

Problem

Ok, I'm stuck, need some help from here on... If I've got a main dictionary like this: ``` data = [ {"key1": "value1", "key2": "value2", "key1": "value3"}, {"key1": "value4", "key2": "value5", "key1": "value6"}, {"key1": "value1", "key2": "value8", "key1": "value9"} ] ``` Now, I need to go through that dictionary already to format some of the data, ie: ``` for datadict in data: for key, value in datadict.items(): ...filter the data... ``` Now, how would I in that same loop somehow (if possible... if not, suggest alternatives please) check for values of certain keys, and if those values match my presets then I would add that whole list to another dictionary, thus effectively creating smaller dictionaries as I go along out of this main dictionary based on certain keys and values? So, let's say I want to create a sub-dictionary with all the lists in which key1 has value of "value1", which for the above list would give me something like this: ``` subdata = [ {"key1": "value1", "key2": "value2", "key1": "value3"}, {"key1": "value1", "key2": "value8", "key1": "value9"} ] ```

Original source