Spaces:

---

prithivMLmods

/

Multimodal-OCR

like 378

Running on Zero

Hello everyone

I have never really used AI before other than occasion chatting on openai's chatgpt.

I have a project id like to work on which is digitizing recipes. I used this model and was blown away by the results. I want to take photos of my recipie books and then digitize them. This model looks wonderful.

My question is, how can i run this locally. I have never done this before so if you have advice please dumb it down abit. I am barely confident with comand line interfaces but can do it. Do i need to download any software?

Can it be run on the network as an ip:port? so if i took a photo with my phone i could use a web interface to access it?

How does it all work? what do i need to do to run these models locally?

Thank you

As for my test, I uploaded this image

and it output:

Chocolate Cake

Ingredients:

• 3/4 cup (1 1/2 sticks) unsalted butter, room temp, plus more for pan
• 3 large eggs
• 3/4 C unsweetened cocoa powder, plus more for pan
• 1 tsp. pure vanilla extract
• 3/4 C all-purpose flour
• 1/2 C sour cream
• 1/2 tsp. baking powder
• 1 C sugar
• 1/4 tsp. salt

GLAZE
sweetened whipped cream, for serving (optional)
chocolate shavings, For serving optional

PROCEDURE

1. Preheat oven to 350°F.

2. Sift cocoa, flour, baking powder & salt; set aside. Cream butter & sugar until light & fluffy. Beat in eggs, one at a time, then beat in vanilla. Reduce speed to low. Add flour alternating with sour cream, starting & ending w/ the flour mixture.

3. Spread batter into pan. Tap pan firmly on countertop, to force out large air bubbles. Bake until toothpick comes out clean, 30-35 mins.

4. Remove from oven, cool 10 mins. in pan, then invert onto a wire rack to cool completely. Pour glazed. Let stand to set. Serve.

Cakey Brownies

Ingredients:

• 1/2 stick unsalted butter, cut into large pieces
• 4 oz. bittersweet chocolate, coarsely chopped
• 1 1/2 C sugar
• 3 large eggs
• 1/4 C unsweetened Dutch-process cocoa powder
• 3/4 tsp. coarse salt
• 1 1/2 C all-purpose flour
• 3/4 tsp. baking powder

PROCEDURE

1. Preheat oven to 350°F. Line baking pan with parchment paper, leaving a slight overhang on all sides.

2. Melt butter & chocolate in a double boiler or a heatproof bowl set over a pot of simmering water.

3. Whisk in eggs, one at a time, until combined. Whisk in cocoa powder & salt. Fold in flour & baking powder until combined.

4. Pour batter into pan. Bake until set and a toothpick comes out clean w/ moist crumbs, about 30 mins.

5. Let cool in a pan on a wire rack about 15 mins. Lift brownies from pan using parchment. Remove parchment, and transfer to a wire rack. Let cool completely. Cut into 9 pcs. squares.