org.nuxeo.lib.stream.log.internals

Class AbstractLogManager

java.lang.Object

org.nuxeo.lib.stream.log.internals.AbstractLogManager

All Implemented Interfaces:

AutoCloseable, LogManager

Direct Known Subclasses:

ChronicleLogManager, KafkaLogManager

public abstract class AbstractLogManager
extends Object
implements LogManager

Field Summary

Fields

Modifier and Type	Field and Description
protected Map<String,CloseableLogAppender>	appenders
protected Set<LogTailer>	tailers
protected Map<LogPartitionGroup,LogTailer>	tailersAssignments

Constructor Summary

Constructors

Constructor and Description
AbstractLogManager()

Method Summary

Modifier and Type	Method and Description
protected void	checkInvalidAssignment(String group, LogPartition partition)
protected void	checkInvalidCodec(LogPartition partition, Codec codec)
void	close()
protected abstract void	create(String name, int size)
protected abstract <M extends Externalizable> CloseableLogAppender<M>	createAppender(String name, Codec<M> codec)
boolean	createIfNotExists(String name, int size) Creates a new Log with size partitions if the Log does not exists.
<M extends Externalizable> LogTailer<M>	createTailer(String group, Collection<LogPartition> partitions, Codec<M> codec) Creates a tailer for a consumer group and assign multiple partitions.
boolean	delete(String name) Tries to delete a Log.
protected abstract <M extends Externalizable> LogTailer<M>	doCreateTailer(Collection<LogPartition> partitions, String group, Codec<M> codec)
protected abstract <M extends Externalizable> LogTailer<M>	doSubscribe(String group, Collection<String> names, RebalanceListener listener, Codec<M> codec)
<M extends Externalizable> LogAppender<M>	getAppender(String name, Codec<M> codec) Gets an appender for the Log named name, uses codec to encode records.
<M extends Externalizable> List<Latency>	getLatencyPerPartition(String name, String group, Codec<M> codec, Function<M,Long> timestampExtractor, Function<M,String> keyExtractor) Returns the lag with latency.
protected abstract int	getSize(String name)
protected <M extends Externalizable> Codec<M>	guessCodec(Collection<LogPartition> partitions)
protected boolean	sameCodec(Codec codec1, Codec codec2)
int	size(String name) Returns the number of partition of a Log.
<M extends Externalizable> LogTailer<M>	subscribe(String group, Collection<String> names, RebalanceListener listener, Codec<M> codec) Creates a tailer for a consumer group and subscribe to multiple Logs.
boolean	supportSubscribe() Returns true if the Log LogManager.subscribe(java.lang.String, java.util.Collection<java.lang.String>, org.nuxeo.lib.stream.log.RebalanceListener, org.nuxeo.lib.stream.codec.Codec<M>) method is supported.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.nuxeo.lib.stream.log.LogManager

createTailer, createTailer, createTailer, createTailer, createTailer, exists, getAppender, getLag, getLagPerPartition, getLatency, getLatency, getLatencyPerPartition, listAll, listConsumerGroups, subscribe

Field Detail

appenders

protected final Map<String,CloseableLogAppender> appenders

tailersAssignments

protected final Map<LogPartitionGroup,LogTailer> tailersAssignments

tailers

protected final Set<LogTailer> tailers

Constructor Detail

AbstractLogManager

public AbstractLogManager()

Method Detail

create

protected abstract void create(String name,
                               int size)

getSize

protected abstract int getSize(String name)

createAppender

protected abstract <M extends Externalizable> CloseableLogAppender<M> createAppender(String name,
                                                                                     Codec<M> codec)

doCreateTailer

protected abstract <M extends Externalizable> LogTailer<M> doCreateTailer(Collection<LogPartition> partitions,
                                                                          String group,
                                                                          Codec<M> codec)

doSubscribe

protected abstract <M extends Externalizable> LogTailer<M> doSubscribe(String group,
                                                                       Collection<String> names,
                                                                       RebalanceListener listener,
                                                                       Codec<M> codec)

createIfNotExists

public boolean createIfNotExists(String name,
                                 int size)

Description copied from interface: LogManager

Creates a new Log with size partitions if the Log does not exists. Returns true it the Log has been created.

Specified by:

createIfNotExists in interface LogManager

delete

public boolean delete(String name)

Description copied from interface: LogManager

Tries to delete a Log. Returns true if successfully deleted, might not be possible depending on the implementation.

Specified by:

delete in interface LogManager

size

public int size(String name)

Description copied from interface: LogManager

Returns the number of partition of a Log.

Specified by:

size in interface LogManager

createTailer

public <M extends Externalizable> LogTailer<M> createTailer(String group,
                                                            Collection<LogPartition> partitions,
                                                            Codec<M> codec)

Description copied from interface: LogManager

Creates a tailer for a consumer group and assign multiple partitions. Uses codec to decode records. Note that partitions can be from different Logs. A tailer is NOT thread safe.

Specified by:

createTailer in interface LogManager

guessCodec

protected <M extends Externalizable> Codec<M> guessCodec(Collection<LogPartition> partitions)

supportSubscribe

public boolean supportSubscribe()

Description copied from interface: LogManager

Returns true if the Log LogManager.subscribe(java.lang.String, java.util.Collection<java.lang.String>, org.nuxeo.lib.stream.log.RebalanceListener, org.nuxeo.lib.stream.codec.Codec<M>) method is supported.

Specified by:

supportSubscribe in interface LogManager

subscribe

public <M extends Externalizable> LogTailer<M> subscribe(String group,
                                                         Collection<String> names,
                                                         RebalanceListener listener,
                                                         Codec<M> codec)

Description copied from interface: LogManager

Creates a tailer for a consumer group and subscribe to multiple Logs. The partitions assignment is done dynamically depending on the number of subscribers. The partitions can change during tailers life, this is called a rebalancing. A listener can be used to be notified on assignment changes. Uses codec to decode records.

A tailer is NOT thread safe.

You should not mix LogManager.createTailer(java.lang.String, java.util.Collection<org.nuxeo.lib.stream.log.LogPartition>, org.nuxeo.lib.stream.codec.Codec<M>) and subscribe usage using the same group.

Specified by:

subscribe in interface LogManager

checkInvalidAssignment

protected void checkInvalidAssignment(String group,
                                      LogPartition partition)

checkInvalidCodec

protected void checkInvalidCodec(LogPartition partition,
                                 Codec codec)

getAppender

public <M extends Externalizable> LogAppender<M> getAppender(String name,
                                                             Codec<M> codec)

Description copied from interface: LogManager

Gets an appender for the Log named name, uses codec to encode records. An appender is thread safe.

Specified by:

getAppender in interface LogManager

sameCodec

protected boolean sameCodec(Codec codec1,
                            Codec codec2)

getLatencyPerPartition

public <M extends Externalizable> List<Latency> getLatencyPerPartition(String name,
                                                                       String group,
                                                                       Codec<M> codec,
                                                                       Function<M,Long> timestampExtractor,
                                                                       Function<M,String> keyExtractor)

Description copied from interface: LogManager

Returns the lag with latency. Timestamps used to compute the latencies are extracted from the records. This requires to read one record per partition so it costs more than LogManager.getLagPerPartition(String, String).
Two functions need to be provided to extract the timestamp and a key from a record.

Specified by:

getLatencyPerPartition in interface LogManager

close

public void close()

Specified by:

close in interface AutoCloseable

Specified by:

close in interface LogManager