kvs_stream.htm 7.7 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182
  1. <!DOCTYPE html>
  2. <html><head><meta charset="utf-8" />
  3. <meta http-equiv="Content-Type" content="text/html; charset=utf-8" />
  4. <meta name="viewport" content="width=device-width, initial-scale=1.0" />
  5. <meta name="description" content="" />
  6. <meta name="author" content="Maxim Sokhatsky" />
  7. <title>STREAM</title>
  8. <link rel="stylesheet" href="https://n2o.dev/blank.css" />
  9. <link rel="stylesheet" href="https://n2o.dev/zima.css" />
  10. </head><body><nav>
  11. <a href="https://n2o.dev">DEV</a>
  12. <a href="https://kvs.n2o.dev">KVS</a>
  13. <a href="#" style="background:#ededed;">STREAM</a>
  14. <div class="dropdown">
  15. <a onclick="drop()" class="dropbtn">EN</a>
  16. <div id="dropdown" class="dropdown-content">
  17. <a href="https://n2o.dev/deps/kvs/man/ua/kvs_stream.htm">UA</a>
  18. <a href="#">EN</a>
  19. </div>
  20. </div>
  21. </nav><header>
  22. <a href="../index.html"><img src="https://openmoji.org/data/color/svg/1F4BF.svg"/></a>
  23. <h1>STREAM</h1>
  24. </header>
  25. <main>
  26. <article>
  27. <section>
  28. <h3>INTRO</h3>
  29. <p>The STREAM module provides chain persistence, accumulation and traversal.</p>
  30. <blockquote>
  31. <ul><li><b><a href="#writer">writer/1</a></b> — creates writer cursor for chain.</li>
  32. <li><b><a href="#reader">reader/1</a></b> — creates reader cursor for chain.</li>
  33. <li><b><a href="#save">save/1</a></b> — stores cursor to db.</li>
  34. <li><b><a href="#load_reader">load_reader/1</a></b> — loads reader cursor.</li>
  35. <li><b><a href="#top">top/1</a></b> — returns top of the reader.</li>
  36. <li><b><a href="#bot">bot/1</a></b> — returns bottom of the reader.</li>
  37. <li><b><a href="#next">next/1</a></b> — moves reader next.</li>
  38. <li><b><a href="#prev">prev/1</a></b> — moves reader prev.</li>
  39. <li><b><a href="#take">take/1</a></b> — takes N elements from reader.</li>
  40. <li><b><a href="#drop">drop/1</a></b> — skips N elements from reader.</li>
  41. <li><b><a href="#add">add/1</a></b> — adds element to writer.</li>
  42. <li><b><a href="#append">append/2</a></b> — appends element to feed.</li>
  43. <li><b><a href="#append">remove/2</a></b> — removes element from feed.</li>
  44. <li><b><a href="#cut">cut/2</a></b> — cleans-up the feed up to the key.</li>
  45. </ul></blockquote>
  46. <p>You can grab <a style="margin-bottom:30px;" href="https://raw.githubusercontent.com/synrc/kvs/master/src/layers/kvs_stream.erl">kvs_stream</a>
  47. and use it in your applications without importing <b>synrc/kvs</b> dependency,
  48. as this module is self-containing.
  49. The possible applications are: public and private feeds, FIFO queues,
  50. unread messages, chat applications, blockchain etc.<br /><br /></p>
  51. </section>
  52. <section>
  53. <h3>WRITER</h3>
  54. <p>Writer cursor represents unique append list chain with some cached values.
  55. E.g., elements <b>count</b>, <b>first</b> element of the chain, <b>cache</b> field for value of
  56. a previous written message and <b>args</b> field for passing arguments in fixpoint style.</p>
  57. <figure><code> -record(writer, { id = [] :: term(),
  58. count = 0 :: integer(),
  59. cache = [] :: [] | tuple(),
  60. args = [] :: term(),
  61. first = [] :: [] | tuple() } ).</code></figure>
  62. <p>For adding data to storage you need to create writer cursor,
  63. set the <b>args</b> field with the record to be added:</p>
  64. <figure><code> > require KVS
  65. KVS
  66. > KVS.writer
  67. {:writer, [], 0, [], [], []}</code></figure>
  68. <h4 id="writer">writer(list()) -> #writer{}.</h4>
  69. <p>Creates writer cursor. After this you normally call <b>save</b> function for cursor persistence.
  70. As a parameter provide cursor name as a list.</p>
  71. <figure><code> > w = :kvs.writer '/cursors/cur1'
  72. {:writer, '/cursors/cur1', 0, [], [], []}</code></figure>
  73. <h4 id="save">save(#writer{}) -> #writer{}.</h4>
  74. <p>Flushes writer cursor to database.</p>
  75. <figure><code> > :kvs.save w
  76. {:writer, '/cursors/cur1', 0, [], [], []}
  77. > :kvs.get :writer, '/cursors/cur1'
  78. {:ok, {:writer, '/cursors/cur1', 0, [], [], []}}</code></figure>
  79. <h4 id="add">add(#writer{}) -> #writer{}.</h4>
  80. <p>Adds element to persistent chain declared by writer cursor.
  81. Adding elements to chain affects <b>count</b> field.</p>
  82. <figure><code> > :lists.map fn _ ->
  83. {:ok,w} = :kvs.get(:writer,'/cursors/cur1')
  84. :kvs.save(:kvs.add(KVS.writer(w, args: {:"$msg", [], [], [], [], []})))
  85. end, :lists.seq(1, 5)
  86. [
  87. {:writer, '/cursors/cur1', 1, {:"$msg", '1313544188019000'}, [], []},
  88. {:writer, '/cursors/cur1', 2, {:"$msg", '1313544189127000'}, [], []},
  89. {:writer, '/cursors/cur1', 3, {:"$msg", '1313544189869000'}, [], []},
  90. {:writer, '/cursors/cur1', 4, {:"$msg", '1313544190519000'}, [], []},
  91. {:writer, '/cursors/cur1', 5, {:"$msg", '1313544191134000'}, [], []}
  92. ]
  93. > :kvs.get :writer, '/cursors/cur1'
  94. {:ok,
  95. {:writer, '/cursors/cur1', 5, {:"$msg", '1314009332950000'}, [], []}}</code></figure>
  96. </section>
  97. <section>
  98. <h3>READER</h3>
  99. <p>Reader cursor represents a user reading pointer to the writer feed.
  100. Field <b>#reader.feed</b> is linked to <b>#writer.id</b>.
  101. The <b>pos</b> field represents current position in feed.
  102. Field <b>dir</b> is used for changing <b>take</b> and <b>drop</b> directions.</p>
  103. <figure><figcaption>Reader Cursor</figcaption>
  104. <code> -record(reader, { id = [] :: integer(),
  105. pos = 0 :: [] | integer(),
  106. cache = [] :: [] | integer(),
  107. args = [] :: term(),
  108. feed = [] :: term(),
  109. dir = 0 :: 0 | 1 } ).</code></figure>
  110. <h4 id="reader">reader(term()) -> #reader{}.</h4>
  111. <p>Creates reader cursor for a given writer id.</p>
  112. <h4 id="load_reader">load_reader(term()) -> #reader{}.</h4>
  113. <p>Loads reader cursor from database.</p>
  114. <h4 id="save">save(#reader{}) -> #reader{}.</h4>
  115. <p>Flushes reader cursor to database.</p>
  116. <h4 id="bot">bot(#reader{}) -> #reader{dir = 0}.</h4>
  117. <p>Changes the direction of the cursor to take foraward (normal).</p>
  118. <h4 id="top">top(#reader{}) -> #reader{dir = 1}.</h4>
  119. <p>Changes the direction of the cursor to take backwards.</p>
  120. </section>
  121. <section>
  122. <h3>ITER</h3>
  123. <figure><figcaption>KVS Stream Iterator</figcaption>
  124. <code> -record(iter, { id = [] :: [] | integer(),
  125. next = [] :: [] | integer(),
  126. prev = [] :: [] | integer() } ).</code></figure>
  127. <h4 id="next">next(#reader{}) -> #reader{}.</h4>
  128. <p>Moves cursor to next. Consume data down from top.
  129. Return error if list is empty, otherwise next element or last.</p>
  130. <h4 id="prev">prev(#reader{}) -> #reader{}.</h4>
  131. <p>Moves cursor to prev. Consume data up from bottom.
  132. Return error if list is empty, otherwise next element or last.</p>
  133. <h4 id="drop">drop(#reader{}) -> #reader{}.</h4>
  134. <p>Drops N elements starting from reader.</p>
  135. <h4 id="take">take(#reader{}) -> #reader{}.</h4>
  136. <p>Trying to consume N records from stream using its current value and direction.
  137. Returns consumed data. Usually you seek to some position and then consume some data.</p>
  138. <h4 id="append">append(tuple(), list()) -> term().</h4>
  139. <p>Adds record to feed.</p>
  140. <h4 id="remove">remove(tuple(), list()) -> term().</h4>
  141. <p>Removes record from feed.</p>
  142. <h4 id="cut">cut(list(), term()) -> #ok{} | #error{}.</h4>
  143. <p>Cuts the feed up to a given key.</p>
  144. </section>
  145. <section>
  146. <p>This module may refer to:
  147. <a href="kvs.htm"><b>kvs</b></a>,
  148. <a href="kvs_st.htm"><b>kvs_st</b></a>.
  149. </p>
  150. </section>
  151. </article>
  152. </main>
  153. <footer>2005—2019 © Synrc Research Center</footer>
  154. <script>function drop(){document.getElementById("dropdown").classList.toggle("show");}</script>
  155. </body>
  156. </html>