Scribe - Real time log aggregation used in Facebook

Scribe is a server for aggregating log data that's streamed in real time from clients. It is designed to be scalable and reliable. It is developed and maintained by Facebook. It is designed to scale to a very large number of nodes and be robust to network and node failures. There is a scribe server running on every node in the system, configured to aggregate messages and send them to a central scribe server (or servers) in larger groups.



https://github.com/facebook/scribe

Bookmark and Share          3792



comments powered by Disqus


Related Products

Kafka - A high-throughput distributed messaging system

Kafka provides a publish-subscribe solution that can handle all activity stream data and processing on a consumer-scale web site. This kind of activity (page views, searches, and other user actions) are a key ingredient in many of the social feature on the modern web. This data is typically handled by "logging" and ad hoc log aggregation solutions due to the throughput requirements. This kind of ad hoc solution is a viable solution to providing logging data to Hadoop.

Read more

Scribe-log4j - A Log4j appender that sends log messages to Scribe server.

IntroductionProject provides easy solution to send Log4j messages to scribe server. Project is fork of https://github.com/alexlod/scribe-log4j-appender This project contains 3 maven projects: scribe-client - wrapper of autogenerated java client for scribe. scribe-log4j - appender for log4j. scribe-example - example of use. Log4j propertieslog4j.properties configuration: \tlog4j.rootLogger=DEBUG, scribe\tlog4j.appender.scribe=name.caiiiycuk.scribe.ScribeAppender\tlog4j.appender.scribe.hostname=my

Read more

Logback-scribe - Logback Appender for Facebook Scribe

This project provides logback Appender who sends log messages to Facebook Scribe (a log server) See: https://github.com/facebook/scribe/ How to use itCurrent release: 1.0.0 Maven styleAdd our repository: <repository>\t<id>release</id>\t<name>Bitzeche Releases</name>\t<url>http://trac.bitzeche.de/archiva/repository/release/</url></repository>And add a dependency: <dependency>\t<groupId>de.bitzeche.logback</groupId> <artifactId>logback-scribe</artifactId> <version>1.0.0</version></dependency>Manua

Read more

A-simple-python-facebook-scribe-client - a simple python facebook-scribe client

this is a simple python client for facebook scribe

Read more

Fbas - Facebook Graph API library

Facebook Graph APIApr 2010: Facebook introduced their new API, Graph API, which completely replaces the old REST API. This API has been rewritten to support Graph API. Downloads: http://code.google.com/p/fbas/downloads/detail?name=fbgraph20100511.zip SVN: https://fbas.googlecode.com/svn/trunk/fbgraph What is Graph API Note: please read this section Read: You gave it an url in the form of http://graph.facebook.com/{id}/{connection}, Facebook will return a dynamic object representing the data. Wri

Read more

Facesource - marquee

<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd"> <html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en" id="facebook" class=" no_js"> <head> <meta http-equiv="Content-type" content="text/html; charset=utf-8"></meta> <meta http-equiv="Content-language" content="en"></meta> <script type="text/javascript"> //<![CDATA[ CavalryLogger=false;window.is_quickling_index=""; //]]> </script><noscript> <meta http-equiv="refresh" content

Read more

bshelton229-apache_scribe_pipe_ruby

A ruby gem application that allows CustomLog in Apache to pipe to a facebook scribe logging daemon

Read more

bshelton229-apache_scribe_pipe

A Python script to use with apache's CustomLog to send logs to Facebook's Scribe

Read more

Smallmind-scribe - A logging facade super-set that allows code written to its API to use any underly

A logging facade super-set that allows code written to its API to use any underlying logger. Scribe does not present a lowest common denominator API. Instead, it includes methods for parametrized logging, operationally controlled dynamic configuration, annotation-based logging, complex appenders and filters, user-defined parameters, user-defined metrics, probe points and monitors, logging aspects, extensible pattern and xml based output, and more. Scribe can extend these services to any underlyi

Read more

Fbatg - Integration between Facebook Connect and ATG

Facebook Connect module for ATG applicationsThis ATG module has been designed and developed by PROGIWEB. PROGIWEB is a french company whose activity is to support ATG System Integrators and Customers by providing proven expertise in ATG design, development, architecture, push to production, tuning and maintaining. PROGIWEB is an accredited ATG partner and an official Authorized ATG Training Center. With this project we aim to produce an ATG module that allows anyone with a Facebook account to se

Read more

Related Tags
Browse projects by tags.

Follow feeds Follow bestopensource on Twitter Follow bestopensource on Facebook


Open source products are scattered around the web. Please provide information about the open source projects you own / you use. Add Projects.

Do you provide Consulting, Training, Support for any open source products. Register your business

Tag Cloud >>