console.log

None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
VLM initialization starting ...
VLM initialization completed.
>>> Query: Why is the sky blue?
Assistant: The sky appears blue because of a process called Rayleigh scattering. As sunlight reaches Earth, it's made up of different wavelengths or colors. Shorter wavelengths (like blue and violet) are scattered in all directions more than longer wavelengths (like red, orange, and yellow). The Earth's atmosphere scatters short-wavelength light more, and since we're more likely to see the scattered blue and violet light, the sky appears blue to us. However, the human eye is more sensitive to blue light and less sensitive to violet light, so we perceive the sky as blue, not violet. Additionally, sunlight reaches us more from the blue part of the spectrum, as the sun is higher in the sky during the day, and the blue light is scattered more by the atmosphere. At sunset, when the sun is lower in the sky, the longer wavelengths (red, orange, and yellow) are scattered more, and we see the sky change colors.

Number of generated tokens: 211
TTFT: 0.49s
TPS: avg=10.99, quantiles=['11.09', '11.07', '10.90', '10.88']
>>> Query: Summarize
Assistant: The sky appears blue because of a process called Rayleigh scattering, where shorter wavelengths (like blue and violet) are scattered in all directions more than longer wavelengths (like red, orange, and yellow) by the Earth's atmosphere. The human eye is more sensitive to blue light and less sensitive to violet light, so we perceive the sky as blue, not violet. Additionally, sunlight reaches us more from the blue part of the spectrum, as the sun is higher in the sky during the day, and the blue light is scattered more by the atmosphere. At sunset, when the sun is lower in the sky, the longer wavelengths (red, orange, and yellow) are scattered more, and we see the sky change colors.

Number of generated tokens: 159
TTFT: 0.35s
TPS: avg=10.81, quantiles=['10.83', '10.81', '10.80', '10.79']
>>> Query: Tell me a story based on this
Assistant: Once upon a time, in a small village nestled between the mountains, lived a young girl named Aria. Every day, Aria would spend hours gazing at the sky, marveling at its ever-changing hues.

One day, as Aria sat by the river, she noticed something unusual. The sky was not its usual blue, but a deep, rich purple. Intrigued, she decided to find out why.

She spent the next few days researching and studying the behavior of light. She learned about the process of Rayleigh scattering, where shorter wavelengths (like blue and violet) are scattered in all directions more than longer wavelengths (like red, orange, and yellow) by the Earth's atmosphere.

Armed with this new knowledge, Aria set out to share her findings with the village. The villagers were amazed by her discovery and thanked her for her hard work.

From that day on, Aria became known as the "Sky Whisperer" and continued to share her love for the sky with everyone in the village. Every night, the villagers would gather around Aria as she pointed out constellations, planets, and other celestial wonders.

Years passed, and Aria grew old, but her love for the sky never faded. She continued to share her knowledge with the younger generations, inspiring them to look up and marvel at the beauty of the universe.

And so, the story of Aria, the Sky Whisperer, became a legend in the small village, and her love for the sky lived on in the hearts of all who knew her.

Number of generated tokens: 354
TTFT: 0.36s
TPS: avg=10.52, quantiles=['10.62', '10.56', '10.54', '10.40']
>>> WARN:starting syslog with prefix MLA-RT
~MLALogger: logger is closed