Custom GREP with asterisks and anchors?

Question

I have lots of EDI files (which is pretty much a single line of gibberish text) that are about 300mb/pcs.

I'm looking to pattern matching this:

`*UP*605284466346 {lots of other stuff inbetween with set length} QTY*17`

What I know is that UP is at the head of every section followed by the sku at the tail end is QTY with the quantity #.

What I'm trying to find is SKU: 605284466346 with a QTY: 17

This was my valiant attempt:

find * | grep -lir 'UP*605284466346.*QTY\*97' * | grep -v svn

Answer 1

awk is much better for that:

#!/bin/bash

# Usage findsku <SKU> <QTY> <DIR>
# Example: findsku 605284307892 14 ~/mydir
# Result: found ./teste.edi: SKU=605284307892, QTY=14

sku=$1
qty=$2
dir=$3

echo "looking for SKU #${sku} with QTY=${qty} in ${dir}:"

while read -r file; do
    awk -F'*' -v sku="$sku" -v qty="$qty" 'BEGIN{RS="*UP*"} $2==sku &&
    $NF==qty {print "found " FILENAME ": SKU=" sku ", QTY=" qty}' "$file"
done < <(find "$dir" -name "*.edi" -type f)

I think it is pretty much self-explanatory, and you can adapt for any sku and qty values you want. But feel free to ask any question you want about it!

It will recurse in the given DIR, and you can easily adapt it to scan other files besides *.edi